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CHAPTER I. INTRODUCTION 
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A. Background: Children's Television Workshop and "^} ve ^l-^ctt ic Coinpany " 

In 1968, Children's Television Workshop (Crw) vas ^^tablished. 

Its initial purpose was to develop and present a d^ily television 

show for preschoolers — one that would both entertain ^n^l educate. 

The show, Sesair>e Street , quickly gained substantia p^biie approval 

and a large viewer audience. As well, the evaluate on vhic^h va5 

conducted Ecixstlc-.^l Tc.'ting Service (ETS) in<dtcate^ th^-'^t 5qf. nire 

Street was att-^ining rany of the goals it had set ttself,^ 

2 

There were, according to its developers, foUl: r.3j or features 
that SKir-.cd lo faciii.:*Lc Sus. -.o Sii-^cz^s public ^:Viccoss. Tue buGi;et. 
allo^^ed for an 18-ronth prn-broadcas t period thereby 6^.^5urlnI> that a 
considerable ar.rvnt of research and dovelopr.ent toCik Place; the pro- 
gram was created through the interaction of television producers and 
educational researchers. Tnere was sufficient fun<iing to allow the 
more expeusi\e television production techniques to be u^ed x^rhere it 
was felt they were appropriate vehicles for the edi^catiotial message; 
and infornatio-i, promotion, and utilization effort-' woa-^ g^reater than 
those ev3r mde with a public televit;ion program. 

At the end of the first year of So/ja:::e Street s CTl-7 developed a 
proposcil to produce a second television she./, om. that Wes to be aimed 
at children in the primary grades and with reading the content area. 

bee iiall, S. and Hogatz, G., Vx? First Year o_^_J'Sl^^J ^\_^~trc^C : An Evaluatio 
Ld'JcaLional I/.l.L:.'^ btrvic^j, PR /j-13, Oolejcr, ly/c, 

Rof.atz, G. and Ball, S, T^ ie Second Year of Scr>ni:^e St re ^t^: ^ A Continuing 
Evaluation s }:ducational Testing Survice, I'll ll-ll/l^o^rMx: ^ I97l. 

j 

*So^' ral::;er, i:. :\i\d C-ibl on, S. . - S^.w^.,.Q ^tr ^t. Children's 
TcJevision Workshop, New York. December, 19 70^ ' 



The proposal was funded by a consortium that included the United 
States Office of Education, Ford Foundation, Carnegie Corporation, 
John and Mary Markle Foundation, and Mobile Corporation. 

As in the case of Sesame Street , this new reading shew, to be 
called The Electric Company , was developed over a period of more 
than twelve months. The development process involved a series of 
scr.irr s .;hic!i v?ro .^'..:\d\\c:ed lo eslo'-^lish the goals of the show, 
the target audiences of major concern, and soine possible television 
productior* tcch::iques to be used in the sha^. On the basis of these 
sei.unars i^iid loilow'-up discu^sioas , the behavioral goals of The 
jEjertrlc Co--^--;^ rere fomulntcrl. (Thcoe goals v^ro clividoci inio two 
rajor se£':.^ut;s — strategics for symbol/souad analysis and strategies 
for reading for meaning. The goals statement is presented in full 
here as Appendix A.) 

A CT;^ formative research group was established by Dr. Edward L. 
Palmer, CT^^^'s Vice-President for Research. The for::^acive research 
tean ccnductod a i.iL-^ er of ^-.'vJies mder the direcci*.ii of . Barbara 
Fowles and, Jater, Dr. Vivian Homer. Tnese studies looked at the 
t?xisLing cor,peteacies and problems of the target audiences, assessed 
the appeal oi various types of television productir.n techniques, and, 
later, pretested materiaj.53 produeed specifically { r the show. 

Uith In.; gui«c.*;jo of the i,oals and the lormalive research, the 
production ^t..:f of CT.' p.-..;:ired 13:^ h-lf-hour s!ic 5. Ine ]:].'ct.ric 
Company ber.an telccfiijting on October 25, 197J on noncommercial and 
coimerctal statical in the United States and continued broadcasting 
five days a week through April 1972. Typically, the stations tele- 



cast the show during a school hour and then repeated it in the late 
afternoon. Some stations also repeated the five shows for the week 
curing the following weekend. 

In the following sections we shall describe how ETS became 
involved in the summative evaluation of The Electric Company . 



B. Background; Sunir;ative Evaluation 

On May 5, 1971, CTW distributed a Request for Proposal (RFP) to 
evaluate the educational impact of The Electric Comn nnv, The RFP 
specified that the evaluation should be national (or rnulti regional) 
in scope* The sample should be chosen to reflect the target audience 
envisaged for the shov in the following proportions: 

Tar^C!t aK)cirtz:ze Percent of the coLal sanple 

First graders at all levels of reading 20% 
Second graders in the lower half"*" in 

reading achievement 40% 
Tliird gr.'=c!^?,rs in the 3o\*est quarter in 

reading achievement 20% 
Fourth graders in the lowest ouarter in 
<t^'' reading achievement 20% 

lae RFP called for a design that uould include the pretesting and post- 
testing of sampled children. The evaluation was to address itself to 
answering ruch specific qu .-rations as: does the shov: prevent reading 
failure among second graders and provide remedial help among third 
and fourth graders; do the viewing circamstances (home viewing or 
school viCTv'infO mediate the effectiveness of the show; are there 
differential effaces on childten of tlio urban r>oci'% n:ral poor, and 
;:.lddle incor.:e lamilies ; are there any altitude ch<inges in children or 
teachers attributable lo Uo -ho/: ha; doe^ tiie si.ow liucract with 
m.'^Jor approaches to the teaching of reading; what aro the teachers' 
attitudes toward the ahcrvj* 



^In relation to a national norms distribution. 
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As well as thase specific questions the RFP also called for a 
number of other studies that would indicate whether the show had 
special effects on Spanish-background children, different effects 
on boys compared with girls, greater effects on children who viewed 
more, different effects when viewed on color versus black and white 
sets, or when vie^^ed by classes whcse teachers were given teacher 
guides • 

Tlie summaLive evaluation of The Electric Company was initiated 
by CTW in conjunction with its various funding agencies and its 
research advisory board. ETS wrote its proposal, wh-J.ch was 
subscquantly c-ccpted, trying where practicable to be respon^sive to 
the evaluation goals outlined. We did not address our work to obtain- 
ing answers to all the questions outlined in tho RFP. There were 
limitations of tine and money and some priority ordering took place. 
Even though we had to focus on a nuirber of questions posed in the 
RFP, it was possible nonetheless to add other questions of our own. 

It should be printed out at this stage that there were various 
important evaluation questions not posed in the RFP and not posed 
independently by us. Not every relevant question could be addressed 
even by a number of ovpJuotion studie:; ~ evaluavion re^enrch costs 
money and fundi:- a-encic- iiave to strike: a rca:;ui;able balance among 
program development, program dissemination, and proj>ram evaluation. 
It f^houlc! ho reric::l)ered too that thh: evaluation concerns the first 
year of a new educational program, llie shcM has been continued into 
a second year, and quite properly, evaluation al.^o continues into 
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the second year.^ Evaluations conducted after these initial efforts 
should be based on earlier findings, be aiired at replicating these 
findings, should look for related effects, and should strive to 
answer questions not previously asked. Of course each phase in the 
evaluation cycle may also be expected to raise new research questions. 

Put negatively, the evaluation to be described in the following 
pages does no'^ attc.pt tJ an-^i/er questions concerning cor:>t benefit and 
cost effectiveness, alternative ways of reaching the same goals, 
the worthiness of the goals selected for the show, the effectiveness 
of the show on various important (but non-target) groups such as 
preschcol-c^^tn children, educable r..:nt:cJly ri^tarciod children, 
eaiotionally disturbed children, and illiterate adults. Furthermore, 
the number of potential positive and negaflvo side-effects is legion 
and, while we did check on some of them, many were beyond the 
province of our first year evaluation. Tliese include changes among 
viewers in academic subjects other than reading, in library borrow- 
ing, in creative and rrport writing, and in chll.Vt^-achcr interactioiis , 
Further, v/e did not lock at effects of home viewing on younger or older 
siblings of sampled target children, the effects of the show on other 
television sha./s, and th^^ effects of the shw on the teaching styles 
of viewing tc^a.^'^crs. All thef^e (and rrore) nre l.'gill^.ole qiivMtions. 
Ihey did not cor.;e at Uie top of . the priority list developed by us 
frd tlie R:\? w.r.d fj cr. up*. r.-i,ioii.> 1 co:..>i co rntioiK . \:olcr...c the work 
of other ret>earchers , especially tiiose witii backg rounds in sociology. 

We are currently conducting a follow-up study of some of our first year 



economics, anthropology and philosophy* All will be needed for a 
properly rounded set of evaluation studies. 

In positive terms, this evaluation is primarily interested in 
discovering whether the first year of The Electric Cornpany achieved 
its main intended outcomes with its major categories of target 
audiences. We also looked at some non-target audiences, for some 
possible unintended outcoines, and for some potentially important 
moderating variables. In general it will be seen that we addressed 
our evaluation to most of the questions posed in the RFP along with 
some questions we independently deemed to be of high priority and 
witliin the confines of practicabil:Lty • We think that this evaluation 
is a first step in the overall evaluation of Th e Electric Comoany . 



CHAPTER II . PREPARING FOR THE EVALUATION 
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^ A. Research Design and Sairrpling Procedures 

TVo designs were developed for this study. Each was intended 
to isolate the effects of viewing The Electric Cotr.pany in a different 
setting ~ one setting was viewing in school and the other was view- 
ing at home. 

In order to study the effects of viewing in school we sought 
sites where The Electric Cotapany was to be telecast solely during 
school hours. This would allow the establishment of a group whose 
viewing in school could be ensured (experimental) and a group which 
would not be able to view the show at all (control group), Tliat is, 
the group th£X would not be seeing the shew in school would not be 
able to go home after school and see the shm as it was not sho^^n 
then. Further the experimental group (in-school viewers) would 
'\ also be unable to view at home. 

For the hon.e viewing do.^ign \;e needed sites where telecasting 
of the show included a daily presentation after school hours. The 
shw could also be telecast during school hours provided Scimpled 
childr-n (experi..,ental aad conlvol) could not v±c.^ it then. 

All sites also had to htive the following characteristics. They 
had to have 2 school syi;t--\ l^.rze enou/n to have a substantial number 
of classroovs in grades one through four, a substantial nurAer of 
children e.ipcricucin;; difriculty in nnJIn^;, and a variety of read- 
ing programs In the schoo.:. to allcv <3.m;.o asscn.^ment of the inter- 
actions be^,^^een type of rending program and viewing of The Electric 
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Given the constraints of time and cost, the problems inJierent in 
large scale field operations, and the site characteristics necessary 
to conduct the two studies, wo decided to work in four sites rather 
than attempt a representative sampling of sites. Since the two designs 
required quite different schedulings of the show, a single site could 
not be used to assess the effects of both viewing conditions. 

Tae selection of sites to conduct the in-school viewing evalua- 
tion proved to be the more difficult since most areas in the nation, 
especially those with relatively large school systems, were telecast- 

The.Klectr1c C^ tdsv^^t both during nnd after sch-.l hours. Vic-- 
uvcr, two siLes were found that fulfilled the necessary requirements 
Fresno, California and Youngs town, Ohio. The Frcsr.o County area 
haz no public television station but does have a closed-circuit tele- 
vision system in its schools. CTW and ETS arranged for the Fresno 
County Department of Education to receive a full set of tapes of the 
show during the telecast period, and the school systems within the 
county's jurisdiction rec( iv^^d the sha.^ on clojod-ci rcuit television. 
Fresno County not only provided an apprcprlat? ,i:id c.->operati ve iralieu 
in which to work, but it also had a desirable variety of children 
(urban, rur.-l, vhlte, r.nd Spiin:^li back-rou .d) . 

Ti)0 soccj-d cjitc for the in-school vir-iuj^ ov,iluntion, Youngstown, 
Ohio, also had no public television stntlon in rh ■ rcriod in \/!i3ch 
ouv study w.v; bcinf^ conducted. Hovcnvr, the looai ^^.ftiUiito of CHS 
in Youngsto;v'n did agree to telecast JLL^c tjj c CoPDajw durliu; school 
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hours as a public service. Youngs town provided both an urban setting 
in the Midwest and a curious historical coincidence. William McGuffey, 
whost reading books were so famous in earlier generations, was born 
and educated in Youngstown, Ohio, From McGuffey^s Readers to The 
Electric Company , 

The two at-hor.e viewing sites were Richmond, Virginia, and 
Vflshir.^ton, D, C. Both prorfded us with large »irban areas and both 
W'l^re served by UlIF rather than the more audieuce-actracting VHP tele- 
vision statior.f. . Sites served by UHF were chosen in the hopes of 
pravcuaiig :...iGsive viewing of the show by control children. The dis- 
advantages of these sites were that they were close geogrcphically 
(thoufh they rc^present different kinds of urban environcients) , and 
they contained a disproportionately high percentage cf black children 
(especially Washington, D. C). 

The s£.iplir.g plan was the same in all four sites. First we 
obtained a listing of schools and classrooms which contained a pre- 
ponderance of target children — namely, first graders of all levels 
of reading achievement, second graders in the bottom hi If of their 
grade in terms of national norms of reading achi^veraeat, and third 
and fourth graders in the lowest quarter of their grade in terms of 
national reading nonns . The next step was to ask school principals 
to pair such cJasS'js in thair ft^iiools within each grade on the 
criterion of perforMnce i.^ reading or reading readiness. Some 
principals explained that in their scliools children were grouped by 
ability so that no classes cuuld be paired on this criterion. Such 
schools were not used in the study. Almost all principals were able 
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to provide us with the pairings as requested. Within each school, 
the local coordinator was instructed to randomly assign one member 
of each pair of classes to a viewing condition and the other to the 
control condition. Ihis was done for 20 pairs of first grade classes, 
40 pairs of second grade classes, 20 pairs of third grade classes, 
and 20 pair.^ of fourth grade classes in each of the four sites. (See 
liable 1 fur the sar-i^iing d:-;.i£n.) 

The studies then entailed the pretesting of sar.pled classes in 
all four sites during late Septer.ier and early October, 1971. The 
expevimental classrooms received the experimental treatment during the 
fcllovir.s six r.'^nthn, and all clc-.scs were posttented in Mav, 1972. 

In subsequent sections of this chapter, we shall present a 
description of the field operations, the experimental treatments, and 
the measuring instruments used in the studies. 
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F ield Operations 

In the In-school and at-home viewing sites, the school classr- -r 
was our unit of sampling and analysis. Ihe Initial contacts in each 
site and the ultimate approval to work in each site were therefore 
made with the school systems. At the request of the school systems 
in fresno and Youngs town, ETS negotiated fixed-cost contracts whereby 
each school system provided the cooperation and the local personnel to 
carry out the study. In Richmond and Washington, the school systems 
preferred that ETS hire all personnel and supervise all activities. 

VHiilG the financial arrangements differed in the sites, the field 
operations were essentially the sar.o-. In each site, the initial act 
was to npnoint a local coordinator to oversee the field operations. 
In three cases, the coordinator was or had recently been an employee 
of the school system in the capacity of teacher or substitute teacher. 
In Wa8hiiv;ton, a ne.r employee of the ETS regional office in that city 
had recently left the Washington schools and became the local coordlnac. 

Since all local coordinators had strong ties with their sdiools, 
and sIv.Tc UTS had previously ijainau the schools' cooperation, the 
responslblllb/ for hiring testers was given to the coordinators. All 
t-C'.sters and tester-aides were people who had previous experience with 
young chlldror, usually as teachers or substitute teachers. The local 
coordinator also h.-.d mr^por.'^ihni ty for supervising the work of the 
testers pnd aides during pi-etosting and posttesting, for scheduling 
testing sessions with classes, for controlling the quality of data by 
checking each docur.ent before fon/ardlng materials to F.TS, and for 
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Field Operations 
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> In the in-school and at-home viewing sites, the school cl.r-.^ : ■ 
was OV.T unit of sampling and analysis. Ihe initial contacts in end, 
site and the ultimate approval to work in each site were therefore 
made with the school systems. At the request of the school system, 
in Fresno and Youngs town. ' ETS negotiated fixed-cost contracts wherebv 
each scliool system provided the cooperation and the local personnel t. 
carry out the study. In Richmond and Washington, the school systenu. 
preferred that ETS hire all personnel and supervise all activitfor.. 

I^ile the financial arrangewunts differed in the sites, the iiei. 
operatio>is were essentially the sar^. In each site, the initial act 
was to appoint a local coordinator to oversee the field operations. 
In three cases, the coordinator was or had recently been an en^loyee 
of the school system in the capacity of teacher or substitute teacher. 
In Washington, a ncn^' enployee of the ETS regional office in that city 
had recently left the Washington schools and became the local coordina 

Since all local coordinators had strong ties with their schools, 
and sirce ETS had previously gained the schools' cooperation, the 
responsibility for hiring testers was given to the coordinators. All 
testers and tester-aide^ were people who had previous experience with 
young children, usually as teachers or substi tute' teachers . The local 
coordinator also had -^ponsi bili ty for supervising the work of the 
testers and aider, during pretesting and posttesting, for scheduling 
testing sessions with classes, for controlling the quality of data by 
checking each documenr before forvarding nuiterials to ETS, and for 
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Q coordinating all activities by serving as liaison bemeen testers and 

ETS and between the local school system and ETS . Coordinators in 
Rlohr.-.ond and Vashington were also responsible for handling all fiscal 
matters related to field operations. 

A two-day brieJing and training session for coordinators was held 
at ETS in early September. 1971. At that session, the project was 
explained and coordinators vc-ro instructed in san^pling and testing 
procedures. Coordinators then trained their local testers and aides 
to administer the tests. 

Duri:-.2 the first vcek of testing in each site, an ETS staff n^nd,er 
helped in the supervision of testing and observed each tesfc.r a:.d aide 
during an entire testins session to ensure uniforiuity of procedures. 
-nye ETS person also supervised the selection of cJasses for the study 
O ^nd the randoiuized assignment of the experimental treatment. After the 

first week, the coordinators r.ssuned full responsibility for monitor- 
ing the testing. 

AL'ter the pretesting nnd the collection of parent and teacher ' 
questionnaires, coordinators checked the data for completeness, ihis 
was a lengtlw proces. given the 100 classes and approximatclv 2500 
ch:Llc:re:>. who .-.re tested in each site, but it ensured a ndnimum number 
of rejected tests. At ETS, each test was again checked before being 
.cnt to koypun.h. Occ.ion.Uy. ir.cor.lete tc.Ls vere found and they 
were returned to the sites for coirpletion. A]] of thir. ua. riOi-viiow 
nc.c0r7li.heu in the one month before the show began. This process 
was repeated during the post teat period in May, 1972. 
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Betu-een the tvo testing periods, the coordinator was responsible 
for ensuring the n-^intenance of the o^erir.ental and control treat- 
ments. Each classroom in the study was visited at least once a month. 
In the case of the two at-hone vic«-ing sites, teachers were reminded 
to encourage (or not-encourage) viewing; in the two in-school view- 

• i:itc ", te<Tc'"-^rs vre ren-.lnded about their obligation to view (or 
r.ot-viev) the show daily. Coordinators also supervised the adminis- 
tvc-.tion and coricrtion of viewing records. The final job of each 
cuorJinitor curir.s the si:-: r.-..):rJ-.5. of the sha^ v<i3 the monthly 
obsorvaticn of all experimental classes. 
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Ihe Treatment 

In two sites the treatment being evaluated was viewing of The 
Electric Co7:p3,T.y in class and in two sites the treatment was vieu'ing 
the shew In the children's own homes. 
1* The In-school Viewing Treatment 

In Fresno and Youngs tcwn, each experimental classroom was 
supplied with a television set, and the teacher was asked to 
turn the set on to The Electric Company every school day when- 
ever feasible. Control teachers agreed not to show the program 
in their clns'^roors. In Fresno all television sets were black 
and wliit^i leceivers nori.^liy used as part oi that county's 
closed-circuit TV system. In Youngstown, 25 of the experimental 
clciSses were given 21 inch black and white sets and 25 were giver. 
21 inch color sets. Ihe selection of color T\' classes was random 
within grades and enabled us to conduct a study of the effects 
of viewing in color versus black and white. Each experimental 
tc .cl.cr va*5 given copies ol Cii'7's Llectric Cor;.;:c:ny Guide widch 
v;'is V'tiblished every t^^'o weeks and contained information about the 
shows in a two-week period as well as sugf,estions for lessons and 
. a- v. fGll%>.'' *Jp to edch show* 
A^Idj fro:a the television f'cts tiie guides, no cl::er 

r^uppllos or in^omtlon vjere itivcn to the viev.*ing teachers. The 
tir.e o: iha clio./ ci courr-e set c.nd was the i;r.;r.e cac'n ::.,nriing, 
but the toac^ier was left free to dccid.^ which school activity the 
shc-v would supplant. Teachers were also free to use or not use 
thi^ *Au7.< as a r.tcpping stone to otlu'V clcs;;room activities. In 
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other words, the evaluation of Tne Electric Company in these 
sites was a naturalistic one. 
2. Tne At-ho.ne Vicvinp Trcatr.ont 

In Richmond and Washington, the evaluation was directed to- 
ward assessing the effects of the show on children who viewed in 
their own homes. No television sets were supplied to any classes. 
Rather, teachers of experimental classes were asked by LIS and by 
school personnel to "encourage" their children to view the show 
at home and to refrain from showing the program in school. 
Encour:igcr :r.t of children by the teacher consisted of asking the 
children to watch Tne. Electric Corrpany each day after sc::ool and 
difciissi::; the shm in class to instill interest. Teache-s in 
the at-home sites were not given any other direction or ins true tlo 
about the use of the show, but were given copies of the Electric 
Cor.pany G.ide. The not-encouraged classes in these sites were not 
discouraged from viewing the show (which might have had the effect 
of creating curiosity about the sho,^ and therefore \^l^^L.\0* 
Jl :t!.rv, -.on-encourarorent car.e in the form of not mentioning the 
show at aJl. 

"Vxt^;inv/' Is a convoLieut short-hapd way of l.^bcllin^'; t!:e treat- 
.'f.it. T:i'- actuil 3n-i;rliool experimental n nulpulaLion was a:/r:in^ teacru 
t^^ iv.r:\ 07i il.c- ?Vr.- o:\c\\ day in order to have the children view it In 
away the tc;ur.r dor.:od t be educationally sound* lliis r.;ni;Kilatic:: 
was conpietc'y con.;!;; tent with (and, then-fore, confounded wi th) the 
children's actual 1n-richool viewing* Perhaps then, strictly speaking, 
thr irf;i!.r-nt w;:s the j:aininp of the lo:ich.>rs' cooperation, a primary 



20 

dependent variable was the children's viewing the show» and a secondary 
dependent variable was performance on the tests used to assess the chil- 
dren* By the same token, the actual at-home experimental manipulation 
was getting the teachers to encourage the children to view the show at 
home. However, here, the actual viewing could not be expected to be 
cor^letely ccrx.;istent with the teachers' acting as requested (as occurred 
Willi the in-schooi experiments). Not all children in classrooms where 
children were encouraged to view would, in fact, view. Thus, though v/e 
refer to "viewing" as the treatment in the in-school and "encouragement" 
as the treatment in the at-ho7ie experiments, wc realize the cornnlexitic^r 
oi the underlying pheaon^.ena, and the analyses, results, and conclusions, 
hopefully, will benefit from this realization, 
3* The Content of Tae Electric Conpnny 

Viewing of The Electric Conpany was the focus of both the in- 
school and at-home erperinents. The series consisted of 130 half- 
hour programs broadcast five days a week (Monday through Friday) 
for 20 wcf'::s. According to CW,^ the show was designed to teach 
second, third, and fourth jrraders v;ith reading difficulties by 
supplementing clasrrroom reading instruction. Given the limited 
program length r.nd scries duration, it was decided to limit the 
nuni>er cf fo-Is and to focus on thoje reading skills that appeared 
to lend theii^elves to television treatment and would most likely 
benefit children with roadln^t cil'f iculti es . CTW also decided to 
adopt rm eclectic or "cafeteria" approach to teaching rather than 

'^Illg^jjfiA^f J^^ levlsion to Si ipj^legejitj^^ A Pro posal , 

ChiJdron';} ft>jcvislon Workniiop, Ap:ii, 1<P,'} . ' 
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to adopt a single ;r*athod of instruction. In addition, CTW decided 
to make each half-hour show independent of other shows because of 
unpredictable patterns of hone viewing and because of the 
inability to match sha^s with reading instruction. Thus previous 
viewing would not be required for an understanding of a particular 
show. 

In order to describe the actual output of the show that was 
an integral part of the treatment in both the in-school and at- 
home viewing conditions, an analysis of the content of The 
Eloct'^^c Cc"'^n:^y was con(?urted by ETS staff."'" This analysis vras 
done in texr.s of tiie goals set for the show. Vhe goal being 
taught and the technique of presentation was recorded every 30 
seconds for the 130 half hour shoves. This resulted in 7,12A 
separate recordings of goal and treatment — about 59 hours of 
programin<^ time which excluded the t\7o or three minutes of each 
half hour spent on introductions and credits. 

Tabic- 2 indicates the nu:^ber of times and the perccni r.^,c or 
tlrrx: ench r.onl c^roa was ob£:er\^ed during the 130 programs. The 
great majority of time was spent in three goal areas whicli 
accv^v..Uc£i for over 70 ptircent of the chm — syr.bol/sound malysis* 
proca .-^i'.^i lc»ftcr groups, fjnci reading for '.neaaiiii;. Enter Lai anient, 
when no j\fsn] nroi wnr. bcirf directly addressed, accounted for 
tibotit J 6 |£*rci!nt of tl..i shov;. Tahlo 3 takes tiiosc goals tis;jL 
wero treated more than one percent o^ the time and indicntct^ the 
techniques used to present each goal. Tlie primary technique 

^vclion D. 8 contni:i:3 i:.urc tl^.' I ;ii 3od do:*criptlon of the content analysis 
procedure. 
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used to teach every goal was people, and tho second most used 
technique to teach almost every goal was anination (i.e., 
cartoor.s). In generr^l, there was very little difference in 
the approach to each goal. Table 4 presents the techniques 
employed more th.in one percent of the tine ahd indicates the 
goals taught by each technique* Three techniques accounted 
for over 85 percent of the time and these were people, 
anination, and song* 

Overall, the. content analysis indicates that a wide variety 
of goals vns obser^/cd belnp, taught but thr.t the tcchiiiquco oi 
presentation were relatively fe^/ and were similar from goal to 
goal. The content analysis becomes more useful when we present 
the results of the study and begin to relate the achievement 
levels of children to the content they received via The Electric 
Comanv . 
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Measurln;; Ins truiv.cnts 

1. General Considerations 

The evaluation of T he Electric Conrpan y necessitated the 
selection, adaptation, and development of a large number of 
laeasurlng instruments. The focus of the evaluation was the 
child and his or her reading ability, but the child was not 
alone noi could the ciillci be considered as operating in 
isolation. Indeed, the child was part of a class and was 
interacting with that class and its teacher; and the child was 
part of a family and a home environment where, in two of the 
iiil'.i , t\\c c: ; 'jrlr.c.-ilal tre.jt,\.ent Wc:S to occur. 

Because we were interested in finding out about the 
context in which the treatment took place, we needed a variety 
of rr,easuring instruments. These included pretests and posttests 
of ti:e child to assess reading achievement, questionnaires for 
the parents to obtain background information about the .children's 
hu.. ^r. <.nd : iw..: } 1 '^u'> y ques LicnnaiJ os foi the cl<':i:s roor. tcad,c-vs to 
obtain b iogr;iphical and attitudinal information, observational 
records of the classroom reading lessons to assess the kinds and 
ar:ount<^ of rr-n^Jr;.: instruction in the cla<;sGS, vie./ing records 
lYc- zh'' to 0Gtii.:atc the nn.ount Tne rM--^ti:c Co^ .r.y 

was bainp, viewed, and a content analysis of the show to classify 
t:rO :,\\k\ -.jui^Z c i:;otruction bt^'inf, tolovi .ud. Ihe5;c 

measurci; fociii^od on the primary objectives of the show (intended 
outcon:o:;) !iut also included other areas likoly to be affected 
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^ by the show (side effects and transfer effects) as well as areas 

likely to influence the show^s effects (moderator variables). 
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Tests for Childre n 

The research design of the evaluation of The Electric Company 
called for tescir.^ 400 class roor^. ilie Lei>t:ing of the children 
had to be accomplished quickly, given the short period of time 
between the opening of school in early Septenier and the begin- 
nir.g of Che show in late October. The testing had to enconpass 
a wide r<i'.:^2 of reacir.g cjchieverenc behaviors focussing on the 
IntCfudod outcorer- of the rhov but also including possible side 
effects and rcderator variables. 

Ail bu'c one of ihc r.^v.r-i;:rc;s ad.ir.ii; L'. red to the cnilclien 
were dcvelcrod by us specifically for the evaluation. Although 
there are rnny reading tests available, none of them fit the 
primary purpose of assessing the specific goal behaviors of the 
sha.v. Tl^e development of Tne Electric Battery (as these tests 
v;ere called) don::, in cooperation with CT17. ETS staff Tr.et 
with C'lV research and production staff to ensure that the 
battery- VsTs rvrcniiring the goal behaviors as intended by CTl-J. 
In adCilioWy l^^o cxpeits in the i veos of reading, Tr.easurc:..erit of 
rer.;!lng, anc p-i:ycho-li:;i;i:i5tic3 were consulted. These ir.cluded 
br. 3c\iii ii. Ccinoll ci L;S , I'roiej^sors VJaluer H. MacCi::iLie of 
Teachers CoiU:[;o., Colu:..:>ia University, iielen Popp and Dou^Uas 
Pernor o' r U:^lvor:»ity . Ti\c b.ittcry wi::' pilot tc-r^lod on 

c3r,s:-or« of f1rr*t tlir \h fourth grade children In summer schools 
being itcld in the. Jt rscy urea iiud wa;s revised on tlui biu?is 
of these i:^*p;its. 
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All of this development, consultation, pilot testing, and 
revision occurred in a two inonth period, since tests had to be 
printed in August and shipped in Septejiiber for administration 
beginning the end of Septeiriber. Therefore, tne pretesting of the 
children in the evaluation itself became a kind of pilot test of 
the battery on a large scale. The entire battery wa<? subjected 
to an lnic:i.sivo study aili-r the pretesting so that any defective 
iten:s or subtests could be dropped and the tests res cored. 
Although several iten^us were spotted ♦jh^t could have been ir.provcd 
had iin:ct allowed, none was found to be so defective as to need 
elir.ination* 

Tiie Electric Batter>'' included tests intended for group 
administration, a short test given to some children in each class 
on an individual basis, and one section of the Metropolitan 
Achieve "ic At Test appropriate for each grade level. (See Appendix 
R for a description and a copy of the battery.) 
a. Tho r.loc trj c B -'^^ r^r^" Gron.r) T os ts • 

/d though the evaluation required testing classes in 
grades one through four, a single battery was developed. 
TniS was in part due to the short amount of time available 
for test coa' truction, but also because the goals of the 
iJiw vt re t.liC sai.A?. for all grades and our primary objective 
was to assc3S tht, effec-y of the shc^.c in thcvse goal arens 
in each grade, (\ppendix A is a detailed listing oi the 
shovs^'s goals.) 



The children in all grades were tested in groups by a 
tester enrployed and trained by ETS staff. Each tester was 
helped by a tester-aide, also employed by ETS, and by the 
classroom teacher who was requested to stay in the room 
during the testing. Since all classes were group tested, 
it was felt that three adults were needed in each class to 
maintain control in the cl,iss> and to aid individual chil- 
dren who might encounter difficulty in following directions. 
The decision to use group tests was made because of the 
large number of children to be tested. Of equal importance, 
the group testing technique did not require a student to 
pronounce words which might cause dialect and accent to 
affect the tester's scoring of reading performance. 

The group testing made it necessary to design the 
battery nd the test booklets so that children with Hr.ited 
road^ng ability could be validly tested. All tests were 
put in a single booklet, and each page of the booklet was a 
diiicrcnt color so that tue child could e^isily follov tester 
directions (e.g., to turn to the blue page), and so the 
tcT.tor, aide, and teacher could quickly spot any chilawho 
had turned to the wrong page. Thi! riectric Battery was 
cvc.'lcu nrjrncl cno baoic forr.al where: tiu c:;ild selected 
one iA four optio:;s (in the r».iosnrc:; of rL.,"iding ability) 
or one of two op Unas (in the n^a.suros of attitude). By 
r.aintwi ni r:i; a sr.'plc «et of riilos vo ho|>rd to roduco con 
fusJ'jn n:r»on[; the children, Pro.su'Mb:y, too, it insured that; 
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the child's wrong response was not often due to an Inability 
to understand the testing format. For every item, children 
were required to make an X directly in the test booklets 
for the options of their choice. In a large percentage of 
items, choices were among pictures where only the stimulus 
had to be read so that a child's limited reading ability 
did not Qi.-cov.j.:gc hin froni continuing. In every case 
where a picture was presented as a stimulus or option, the 
tester naiaed the picture so that children had both verbal 
and visual clues. Before each class was tested, a short 
pilot tost of six iters v?r. given to allov children practice 
in aucwering the kinds of questions in the actual battery. 
In addition, each subtest was introducod by one or two 
sample iters. On any one page in the booklet, a maximum of 
six items appeared so that pages were uncrouded and easy to 
follow from item to item. 

TliG group letU was conir,neid with t:;e t'^ster ^'^s well as 
the children in mind. The different colored pages of the 
test booklets were matched by the colored piiges of the test 
directions book. Each tester also used an enlargement of 
the Electric Batter>' while administerirg the tests to 
demonstrate tue page and the item at which the child should 
be ]oo!'i r.g. 

Ihere was no time limLt imposed on any item or subtest 
in the battery. Rather, testers were instructed to go as 
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slowly as necessary so that all children would have time to 
answer each question. In cases where a child did not seem 
to understand the group instruction or was unable to keep 
up with the group, he or she was tested individually or in 
a smaller group with the same battery but with more intensive 
supervision. The total testing time varied considerably 
from grade to grade and from class to class within grade, 
but in general two testing sessions of 30 to 45 minutes 
each were required to con?)lete The Electric Battery group 
test, Tr* the fir£:t grade clccses, a shortened version of 
the battery was given at pretest. It was felt that since 
iror>t first graders were nonreaders, che full batter>^ would 
be inappropriate. 

The Electric Battery contained 123 items which were 
categorized to obtain 19 subtests assessing specific goals 
of the show. The subtests can be combined to make four 
tolTxl test scores chat reflect the four major goal areas of 
the r.hzw ;-..-T.-ly bTcr.dlr- of letter sounds, chunking of 
groups of letters, scanning for structure, and reading for 
neanxng, ..lu! tne tests can then be coiTibined into a grand 
total that includes all the 123 iten3 in the Electric 
Battery. 

^ • Al^ Jll^'lL^liiLJi'lH.^i: ^'M_? ^ vidui l Tes t 

In additon to the group- <idininistered battery, some chil- 
dren were ter>ted individually to assess some ^onls that 
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Seo Appendix A for a fuller description of eadi area. 
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required verbalization of responses and to repeat some of 
the group assessments by measuring the child's ability to 
produce certain groups of letters and words. Because of 
the large number of children in the study, individual test-- 
ing was limited to a random sample of 20 percent of the 
children in each class. In the first grade, children were 
individually tested at posttest only. 

The individual test consisted of 42 items and took about 
five minutes to administer. It required the child to read 
aloud rjr.^- \'ordc, fv;c-lvo nonsense tv'ords, and two sentcncps 
nnd to unscrMTibie four sentences whose words were presentee 
in rixGd order. The individual test was administered by 
both Che tester and tester-aide. 
Metropolitan Achievement Tests 

Tn order to dc^scribe the groups of children in the study 
and to identify those children identified as "target** by Crj, 
oae to.->t 01 the 2!etropoiitcin Achieveraent Tests, Harcourt 

r-' Jov-,*: ch, Ire, 1970 Edition, was administered after 
Tlie Electric Battery administration. The particular M\T 
h..\iKjr\ \..riod accor<:iiig to the graJe level as follows: 
UvAuc .1: Preco.-t — rriiver, Part 1 Listening, for Sounds. 
Tr.ls ro.-t i-". dt-crihcd in the MAT Teacher's 
l)irerLionr> y.anu il as a 39-ltt^m test that novisures 
"pupils' kncvleilgc of beginning and ending sounds 
and sound-] otter relatj onships . " 
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Posttest — Primary I, Part 1 Word Knowledge. 
Described as a 35-itein Lest that measures "extent 
of pupils' reading vocabulary/* 
Grade 2: Pretest ~ Primary I, Part 1 Word Knowledge. 

Posttest ~ Primary II, Part 1 Word Knowledge ♦ 
Described as a ^jO-iteni test that noasures "extent 
of a pv.pils*^ readir.£: vocabulary ... .Tu-enty- three 
items require pupil to identify a synonym, antonyir 
or classification for a given word." 

Grades 3 

and 4: Pretest ?ri:.:r^^ II, Part 1 ICcrc Knov^'le 
^ Posttest — Eler:entary Battery-, Part 1, Word 

Knowledge. 

Described as a 50-item test that measures "extent 
of pupils* reading vocabulary. .. .requires pupils 
to identify synonyins, antonyms, or word classifi- 
cation. ... Iterj; rar.i^o from prinary Jevel lo junior 
high level in difficulty." 
Tne Metropolitan Achievement Tests were chosen from the 
many reading achievement tests available for several reasons 
Of pri::r.ry i.-portance was the fact that the test is one of 
Ll*a x^-^^^l -.^i.'Ioly used in sciiools across tlie country and we 
hop., d to b? nble co u '-.cribe our 5;<'i:..;)lc in icn-.-^ that were 
general! liable to nany school situations. Second, the norms 
given for the tests discriminate well among children who 
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score in the lower half and Icvest quarter, a feature not 
common to many other standardized tests. The sample of 
pupils tested to obtain norms for the MAT was selected to 
provide norms that reflected national levels of achievement, 
and the tests were standardized as recently as April, 1970* 
And unlike some other norned tests, where a chance score 
may be equivalent to a percentile rank that soD.etir:.cs 
25, the KiAT provides norms that allow poor readers to be 
distinguished from non- readers who could only perform at 
chance level. Permission to reprint the appropriate sections 
of the for iiiClu^ica in the Electric Battery was granted 
by Harcourt Brace Jovanovich, Inc. Tnis made unnecessary 
the cun-berscr.e handling ar.d coflinj; of t^<o separate booklets 
per child. 

Tabjes 5, 6, and 7 list the tests and subtests adminis- 
tered in the pretest and posttest and the reliabilities 
obtained. The rc>li Joilitie.*; are reporto.d separately for 
each of the groups of major concern in the evaluation. In 
Fresno and Youngstown the reliabilities of the class scores 
for grades owe through four at pretest and at posttest are 
r:iportod aic:;g with the rcli^:bilities of the respective 
gain scores. For Richmond and Washington the reliabilities 
of individual scores lis well a,; class scores are presented 
since both scores are used in the analyses of the data in 

llie reliabilities were calculated using Kuder-Richardson Formula 20. 
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Q these two sites. Tlie reliabilities of class scores on the 

grand total (123 items) and the smaller test totals (blend- 
ing, chunking, scanning, and reading for waning) are 
consistently high and fall below .90 only in the case of 
some gain scores on the smaller test totals. Among the 
subscores, which vary in length from four items to 13 items, 
L;ie rcl^cDiliui^is are so^e^'Lat lower and tend to be lowest 
in subscores with the fewest nui^er of items. The 
reliabilities of class pretest, posttest, and gain scores 
are expectedly somewhat higher than those of indi\^dual 
scores . 

Tables 8 tiirough 11 present the intercorrelations of 
pretest scores and posttest scores on the test totals and 
attitude scales of The Electric Battery, the Metropolitan 
subtests, and in Richmond and Washington, the two viewing 
indices, within each grade and each site. These intercorre- 
lationr. are based on cles.s scores anJ not individual scores 
and this is consonant with other presentations in this 
evaluation. That is, the important analyses to be presented 
in this report are bnsed on clrss avcraros rather than 
individual scores. A nu-ber of ir.tcrcorroIa-Lioru- found in 
Tables 8 throur,h 11 reveal propertiei? of the tests and of 
the coi^.sLn:cCs tu^L the te:)lr. <::ii^06s. 

Tlie intercorrelations of the ter.t totals and the grand 
total of the Electric Battery are usually very hij'ji (in the 

A factor analysis conflnr.ed that one factor accounted 

J 
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for much of the variance among the tests. Ihe matching total 
had the lowest set of correlations with the other test totals 
a:\d this seer3 co be rea<-.cr.able since the rnatching test 
called upon skills least related to the other tests. None- 
theless, in first grade, the matching scores of classes was 
moderately related to the blending, chunking, scanning, and 
rmciv.n for rep-irz scct.!g (In the 60's and 70's). 

A high correlation var: obtained between the grand total 
score?: of classes on the Electric Battery and their scores 
on i.iit r^opGctive ll^irr^-polLiavi reading achievement tcziC — 
in all sites but W.^shlngton thp?e correlntions were in the 
80 's ?.r.d 90 's. 

Hie correlations between the two attitude measures were 
generally low. The two attitude areas being assessed ~ 
S(.hooi and reading — are by no m-^ans identical. That is, 
one could enjoy school but not prefer reviding to other 
school subjects*. Sirilarly, one cou'd prefer reading to the 
oLher scliool suhjCLlt, and r.oi: enjoy sc'.iool. Tnus, the low 
corr£:l?i:ior.<; are lc.r;f; a natter of concern and more a warn- 
ing L.u'it Inc. ottitiJinal aiea Is oni: requiring a multi- 
assessi.jent approach. Attitude to school correlates 
•-.v-:-.ir.^ly (;.;v:-l]y in the :0*:; to ^0^.) w ah perfon::ance 
on the rioctric rttory but the dc^zrco of preference for 
re.iaiu^ a .sciiool subject Joos not: s%'Lud to be correlated 
with reading perfor:iance. 



35 



In each of the tables, the correlations lend credibility 
to the tests themselves in that tests that are conceptually 
related are empirically related. 
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Parent Questionnaires 

Once in the fall before the show began and again in the spring 
folloving the show, questionnaires were distributed to parents of 
all children. Parents were requested, through the teacher, to 
coinplete the questionnaires. Given the large number of children 
involved, it was not economically feasible to offer nioney for com- 
pleting the questionnaire as we had done in the Sesame Street 
evaluations . 

The parent questionnaires provide much information about the 
children, their homes, and their television vlef/7lng habits, 
including sociuecono::ac indicv-s, parental level of aspiration 
for the child, child and parent affluence indices, parental 
attitudes to education and to reading, parental and child reading 
habits at home, and TV viewing habits of the child. At the second 
administration, a section was added to the questionnaire for 
Washington and Richmond to find out from the parents how often 
children v;ai cited Ti e Electric C . r.:;- any and tender what conditions 
the viewing occurred. This was not necessary in Fresno and 
Youngstown as the show was not televised during after-school 
hour:' in thc':e 3itcs. A copy of the prote^^t and posttest 
PrAront: Qu?3 ticnnairc-s i.^ ;;i'c^cr.tc"J a." /.ppendiccs C and D. 

In additio to the item respon<;c,s, six Indices were developed 
froui rL:ipo;);e;; to ccr-..'.In groi:piii^;^ of items in the Parent 
Questionnaires. Tliese were: 

Cliild A fflu ence In: !cx» obtained by adding the yes responses in 
itom 8. It is ba.^e.d on the children's perijonnl possessions in 
the homes. 
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^ Parent Affluence Index , obtained by adding the yes responses in 

item 10. It is based on responses elicited to assess the material 
affluence of the children's homes. 

Years of Parents' Education Index , obtained by averaging the number 
of years of formal education of the children's mother (item 11) 
and father (item 13). V/hen only one of these items was conpleted, 

tiie rerfonbO vras used as the index. This index sen/es as 

one ujcasure of socioeconorJLc status. 

^'ur.ber of Siblings Index , obtained from item 6. 

Sciiool L^jij-ctailon Index , computed separately for pretest and post- 
test iter.- 17-23, e.nd obtsired by adding the voightcd responses. 
It is baiiu on how successful the parents think their children 
are in school as compared vith most other children. 
^ Child Recidine Index , computed separately for pretest and posttest 

items 24 and 26, and obtained by averaging the weighted responses. 
It attcnpts to measure the frequency with which the children are 
rc?d to or rc^ ;d the r-j;clvc'3 at hon^e. 
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Teacher Ques tLoanaircS 

Questionnaires were distributed to all teachers in the study 
once in the fall and again in the spring. Appendices E and F 
present the pretest and post test Teacher Questionnaires. The 
questionnaires were developed by ETS in order to obtain teacher 
backgrouid iniorniation (including educational and teaching 
experience), teachers' attitudes toward such things as educational 
television, various approaches to teaching reading, and the show 
itself. In addition to the item responses, the following scales 
were developed by corbinin©: results from several items: 
Al LJ.l'.icu ic.'dri Hc.wcaticnal TV cbtaii.ed by averag^ing the 

weighted responses to pretest items 25a and 25b and 26a and 26b 
and pcstttat iterr^ 15a and 15b and 16a and 16b. It attempts to 
measure the teacher's attitudes toward educational television 
when used both at home and at school. 

Attitude toward Phonics Index , obtained by averaging the weighted 
rc^pc.v:':? to p:ctc^.t ItL^rrji 25c and 26c and posttest iter.s 15c and 
16c. It atten)pts to nea^ure the teachers' attitudes toward the 
phonic approach to tGaching reading. 

/It'r ^ 'iv:: . ! i.vu '^t.lc^ Indox , obt:>ined by averaging the 
weie' -cc! r- .,p:->m;es to prc*_C3t iten.^ 25d and 26d and posttest 
iteris 15d and ]6d. It attorpts to measure the teachers' attitudes 
to;,.xrd Ii4.^;uL-Uic -.acltcs to teaching reading, 
Atti tudo toward S v s.itra Street Inde x, obtained by the weighted 
respoases to pret.eiJt item 27. It attempts to moa5;ure the extent 
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to which the teacher perceives Sesame Street as a useful tool for 
helping preschool children. 

Attitude tovard Readin;: Perforrance Index , obtained by averaging 
the weighted responses to pretest items 29, 30, and 31 and post- 
test items 17, 18, and 19. It attempts to measure the attitude 
of teachers toward the reading performance and potential 
capability of their children. 

Tne teacher questionnaire was also the main source for 
estimates as to the amount of time spent on reading. While class- 
roor.; obser^v-atlons would have bean a nore objective and realistic 
Tueihou by which to obtain such estimates, the number of classrooms 
(AOO) and the length of each observation (six hours) precluded 
placing heavy reliance on this. At postce^t, the teacher question- 
naire was expanded to include items measuring the experimental 
teachers' attitudes toward The Electric Cor.nanv. 
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Observations of the Classrooms 

A description of the reading program used in each experimental 
classroom was obtained by the observation of classroom reading 
instruction by tne ETS coordinators. Such observations were used 
to see if teacher behavior affected the impact of The Electric 
Conpary on that class. The observational technique was used In 
recognition of the fact that the reading approach teachers say 
they U5,a on a questionnaire or that teachers are directed to use 
by administrators may differ from the approach actually used In 
the classroom. 

In each f^ite, the coordinator observed L:ach expericcntal 
classroom once a month from November through April. Each jf the 
six obser/ations lasted 25 minutes, so that t!ie reading instruction 
In each experimental classroom was observed for two and a half 
hours spread evenly over a six month period. Wh-^le more frequent 
observations would have been desirable, and observations of con- 
trrl clii.-^sroo: 5 would have provided norr/ativa data, funds were 
not available fox* collecting these data. 

During each observation period, the ETS coordinator catego- 
jrl7,ed boch the content of the instruction (primarily in terms of 
the goalj; of Vr.o rloctric Compnny ) and the teaching technique 
used (primarily in teniB of the interactions between teacher and 
chiidreiO. Tiw. catov.. rizations wore in teri?o of durntioii, where 
the observer noted the number of minutes spent on each content 
area and the number of minutes spent using each teaching tech- 
nique. Appendix G provides a copy of the observation form used* 
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In the analyses of the observations, the reading areas were 
considered separately as they closely paralleled the goals of 
the show. However, teaching methods were combined into the 
following groups: 

Child-ce ntered Instruction — includes activities where children 
worked by theniselves; silent reading, writing, workbooks, working 

indlvidurilly or in groups. 

Teacher-c: -.tored In.;t:ructioa — includes activities where the 
teacher vras the focus of the classroom instruction — reading 
aloud, wrlciu^, talking to children, 

^llll^lL^/.:]?JlLiJ};jr^ ~ includes activities where the chil- 

dren and teacher interacted; children reading aloud, children 
writing In front of class, and teacher and children discussing. 

Use of audio-visual materials and nonrcading time were kept 
separate from the other methods. 
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Attendance Records 

One of the many possible side effects of viewing The Electric 
Corp any could be a change in the attitude of viewers tovard school. 
One measure of a children's attitudes toward school is their 
attendance records. Since The Electric Company was actually a 
part of school in Fresno and Youngstown, the attendance of chil- 
dren might likely be affected either positively or negatively if 
the show were providing a strong source of affect for children. 

For these reasons periodic attendance records of each class 
in the sturdy were collected fro:n school records by the ETS 
coordinators. Tae attendance records were collected monthly, 
every six weeks, or bi-monthly depending on each school system's 
normal procedure. A comparison of the experiniental and control 
classes' attendance records may tell us something about the effects 

l^e ^l^cJ'^^c Com any on children's attitudes toward school. 
However, one must always bear in mind that this index probably 
contain;; a lar^e proportion of error variance produced by such 
entraneous factors as attitudes of parents who, for children of 
this age, have the most control over the school attendance of 
their children. 
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Viewing Records 

It was extremely Irnportant to measure the amount of Electric 
Company viewing of each classroom In Fresno and Youngs town and of 
each child In Richmond and Washington, The need was particularly 
great In the two sites where teachers encouraged children to view 
The Electric Conpany at home, since encouragement Is no guarantee 
of viewing and lack of encouragement Is no guarantee of not view- 
ing. One of the greatest problems in our evaluations of Sesame 
Street^, and again in this part of our Electric Company study, was 
the establishment aiid inaiuteaaace of two groups of children who 
differed in the au;ou:it of at-home viewing. Assuming that some 
encouraged childre.. would not view' and soire not-encouraged chil- 
dren would view, it was essential to assess the amount each child 
actually viewed. 

V7ithout the zvoM suro of uoney and highly sophisticated 
technique??, available to such well-known organizations as Nielsen, 
the EIS approach was necessarily one of self-report. Hiis 
tccLxiiquc hivj it.ij obvious dri: /biick.s , only cue of which is the 
unr.c^asured -influence of social desirability of certain responses. 
Hcc'vor, Vhi^ r>tii' / roouired neas^urenont of differences between 
large i\vovj3 (i.e., classes of children) rather than differences 
ai.:c>/,^. i;. 'l/Mv/.l !M?.;::c.a, and the vic.;:':i^ rcajmrof: nre used as 
indicator- cl cL' f I'nrcrvO' . in vicjlnz ^^r.iong groups rather than 
exant dcsjcrjptl ons of an.ount of viewing. 

ciffcr-nt: r-*cV.uros of vir.^'ing wore u£;od in the evalu- 
ation. In tlie tvo jn-<^chcjl vifvlng » tt\ichers were asked 
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to indicate the amount of viewing in their classes once in January 
and again in May. Sin'^e children in these sites could not view 
the show at hone, teachers were the only source of infonnation 
needed. (See Appendix H.) 

In the two at-hoir.c viewing sites, children themselves and 
their parents were asked about their viewing. The children's 
viewing records consisted of pictures representing twelve different 
television shows. (See Appendix H.) Teachers asked their children 
to make an X on a picture if they had seen the show in the last 
week rnd to leave the picture blank if they had not seen the show! 
The Electric Compa ny was one of the pictured shows but was embedded 
in eleven others so as not to draw specific attention to it. These 
viewing records were supposed to be collected four times from each 
classroom (once a month from January to April) but, due to many 
factors, were actually collected from one to four times in each 
classroom. 

The parents in the at-home sites were asked about the 
freqi:Gncy of their children's viewing on the posttest parent 
questionnaire. (See Appendix D.) A score was derived by adding 
tlie wel^:it:cd resrca;:.c.3 to tho following three questions: 
42. Does your child ever watch the TV show Tiie Electric Company ? 
A3. About how many times a week does your child watch The 

Ele ctric Comp nn^ ? 
44. .\}>out how r.uch of each Electric Company show does your child 

usually watch? 
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Ihe use made of these vicving scores varies according to the 
particular analysis conducted. 
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Content Analysis 

A detailed analysis of The Electric Company as it was broad- 
cast was conducted by ETS staff in order to describe the educa- 
tional program being evaluated. The results of this analysis 
have been presented earlier. Once every thirty seconds of each 
show, a notation was made as to the specific goal being taught 
and the specific television technique being used to teach the 
goal. In this way, the amount of tine devoted to each goal and 
to various production techniques over the 130 hours of telecast- 
ing tir.e cnn b3 described, (See Section C3 above.) The content 
analysis data were then related to the test Jala on anount of 
learning. Although none of the observed relationships can be 
considered causal, they provide some insight for future 
production and research. A copy of the actual sdiema used in 
the content analysis appears as Appendix I. 
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CHAPTER III. RESULTS 
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The previous two chapters have indicated the nature of The 
Electric Ccrjpany , how ETS became involved in its evaluation, and the 
research design, sampling plan, and measuring instruments that were 
used in the evaluation. Before proceeding with the presentation of 
the results, it is appropriate to present in summary form the 
questions that were addressed in the evaluation. These questions 
will be addressed again in Chapter IV when conclusions are presented. 

1. What are the effects of viewing The Electric Company in school on 
flrr,t to fourth grcde classes? U'hat are t!;e effects of viewing 
in school on second grade children who score in the lower half 

of tho5r grade on nomed reading achiever.ent tests? \sTiat are 
the effects ot viewing in sdiool on third and fourth grade chil- 
dren who score in the bottom quartile on nomed reading achieve- 
ir^nt taotn? 

2. UTiat are the effects of viewing The Electric Company in school on 
first to fourth grade children from Spanish-background, on black 
children, r;::d cn white chilJ.ron? U^iat are the effects on first 
to fourth grade boys and girls? 

3. Are thcie any differencial effects from vie;;inp. The Electric 
Ccr-pT-r/' in schooi on color TV sets versus on black and white TV 

c» r ? 

^i. V.'lK-it ;u'o tiu^ effects of vicwinj^, Vac EloctrLc Cor-; >nny at hor.e on 
first to fourth gr; de cla^'ses? What are the effects of viewing 
at hor.io on s^econd grade children who r-core in the lower half of 
their rrndr on norn'»(^ reading ;jchiovcr:Cnt tests? Wliat are the 
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effects of vie^^ing at home on third and fourth grade children 
who score in the bottom quartile on nonned reading achievement 
tes ts? 

5. Does frequency of viewing affect the show's impact on children 
viewing at home? 

Oo^s The Electric Company affect the attitudes of children toward 
reading or toward school? 
7* ^oea The Electric Company affect attitudes of teachers or parents 
toward the children and their reading performance? What are the 
attitudes of teachers toward the sha^? 

Ttie following sections of this chapter will describe the sample 
in some detail and will then present the results of the evaluation. 
Tne final chapter will return to the questions presented here and 
answers, based on the results, v/ill be given. 
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Descriplirn of tiie Sample 

1. The Sites 

The following description of the sites is presented to 
provide a background to the study* The descriptions are merely 
inipressionistic and do not constitute substantive data of 
inportanca to the sa::.pling or research design. 

Frtusno Coualy, Cai-.:jniia has a popuiaticn of 43 3, COO 
(19 70 census) and an art^a of alr.ost 6,000 square miles. Its 
county seat is the city of Fresno with a population of 
166,000. The city is relatively modem, yet it is situated 
in i\:c ;.c^rt c: t\\^ ?a:i Joiiquin Valloy , surrouncad by irrf:^:nted 
lands of considerable fertility. Principal products of the 
cou.^/cy l.ic2u^!c grains and fruits (especially melons, grapes, 
and oranges). The main :aanuf acturing industry is drying and 
packing of fruits, but rachine shops, foundries, potteries, 
bri ck^s'orV^ , and soap factories are also represented. Fresno 
Councy ii' 37 l:;:^cptMu :r.L cle:..entary yc'.iool districts includ- 
ing the city of Fre.sno» and the evaluation of The Electric 
Cor.p.'.ny involved nine of them. Tlie schools in the sample 
r; nf,? fvc'\ <i5n"r-c"ty ^';c'^oo?s to relatively remote rural 

Youn^istc-A^n, Ohio is about equidistant (65 miles) from 
Clc\.:l.::.c;, 0:,:o i.v.d I .i.purgh, Pc^n:. ,> 1 v..:^i a. Its gronlcs.t: 
growtii occurred befv^^cen 1900 and 1920, at which point over a 
quarter of tlic population wiis foreif:n-born whitei;. Youngstown 
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is the center of fine agricultural country but its chief product 
is iron .md steel. Both coal and liniestone are available from 
nearby ::J...cS by 1950 it va3 the third largest producer of 
iron and steel in the United States. Over the past two decides, 
the city of Youngs town has shown signs of decay. The population 
in 1960 was 166,700 but ten years later it had dropped to 141,000. 
The center of the city provides an indication of the problems of 
Youagstrvn, where o3 d buildinT^s and unrebuilt lots are conmon. 

lllchr.ond, the capital and largest city in Virginia, was the 
capit^cl city ^'.iC Cc.f C;(>.rcte States fic... i :01 to 1863. The 
city in 1970 hnd a population of 249,400, an increase of over 
30,000 frcn 1?C0. The city is attractively laid out around a 
bend in the James River, has many parks, and is rich in educational 
institutions. Over recent years the city's schools have had an 
increasr'.njly black constituency as white families have moved to 
the suburbs. A court order to use busses to integrate city 
with siiburbrn school districts is currently being hotly argued. 

Vas'.iii..;to;-i, D.C., as the nafion's cr^pital city, is well- 
known and tiieretorc noocs little introduction. Its current 
poi.ulauioa Is /36,I>oJ, down sli^yitiy from 1960. Its public 
school population i£i now about 95 percent black so that de facto 
sc^re^'.t.I is t:;.J j .:lc , Tnc school fivntcn has imdergone a 
nmbor of r>tor:i!y leadership cl^nor'.es over the past few years. 
VJirlle 'i.'aslt lu^Lon, D.C. and its scliool syst.t.':n are unique in many 
ways, nonetheless they have many problems si:nilar to other large 
urban centcx's and their associated school systems. 
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The S^rrnle 

i:it:.ir ecch site ve sought schools where there was a pre- 
ponderance of target children at each grade level. This took 
us into schools ser>/ing a population characterized by 
disproportionate numbers of low income and ininority group 
families. In Youngs town, however, in order to obtain the 
required AO classes at the second grade level, it was necessary 
to use virtually all the available schools- Thus, as we shall 
ree> the Yc'inc^stovn second grade group includes a somewhat 
higher proportion of children with a middle class backgrouud 
than in other sites or other grades. 

The sample to be described in the following pages refers to 
those sampled children in each site for whom complete pretest and 
pocttest data were obtained. Table 12 presents the descriptive 
categorization of the sarr.ple by fiequency and by percentage. It 
may be f,eon that the expectations uere met in most categories. 
There :.re .^'lichtly norc r.ales than females in the sample in each 
site, rcflectinjT, of course, the population characteristics. Tlie 

Mlr-i^- 3roi:pinr<^ vnr>^ greatlv among the sites 

ar.J: Uii;'. part uf the dcsjp.n. Tavs , the porccntage of black 
childrer vnrles from eight percent in Fresno to 97.8 percent in 
Washington. Sii..l Ui>'ly , the p..rconLa^o of ^;n/.rlc who h-^s a 
Sr.r-^is'i b.^C'::rnMnd ra..^oP i roin t.hovX zcio in Washington and 
Rlcn:nond to 50.9 pLi'cont in Fresno, 

All uhiJ'Jr^n in sa-'plc arc r.iir,li<;h npenkinr; to so:ne 
degree bec:aui;e the tcitin- w^u: carried out in Knr.li^b, and any 
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children who did not understand the directions for the test 
were dropped from consideration. However, it is clear that a 
large number of bilingual children was sanTpled, especially In 
Fresno where 44.4 percent of the sampled children are bilingual. 
The sampling was based upon classes which were paired with one 
becondr.g ex^crinantal and the other control. When problezis 
occurred such that a cla::5 had to be dropped from the saiupie, 
its pair was also dropped. Tnus, the number of control and 
experimental classrooms in the sample is the same, so it is 
also not surprising that the proportion of children In the 
expcrircr.tal- control catcf^or)' varied only within the 51-49 
percent range. Although the sampled children came only from 
gracles one through four, their ages range from five- to 12- 
years-old. 

ilie e:cpectation was that, in each site, there would be 500 
first graders in 20 classes, 1,000 second graders in 40 classes 
(800 01 vhoT. vera to be tar^^-t) , 500 third graders in 20 classes 
(including 300 target), and 500 fourth graders in 20 classes 
(including 300 target). (See Table 1.) The obtained numbers 
of c:las:;es, of children, and of target children were some^rhat 
less tlir.n c>:pectcd except in Youngstwn first grade and In 
the fourth grades of Fresno, Richmond, and Washinj^ton. One of 
the r.njor rcar,0;i<; for ....uiininc a sli^^ally smaller sa::;plc: than 
intended was that classes had to be dropped in some sites. In 
Fresno six pairs of second grade classes were lost when it was 
found that the aj?signment of those classes to the experimental 
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Q and control conditions was not random. In Richmond one pair of 

classes vas lost iu third grade when one class i"rom that pair 
was d -resolved during the year and its pupils dispersed among 
other classes. In Washington, two first grade pairs, four 
second grade pairs, and one third grade pair were lost when the 
treatment broke down in two schools. In those schools some 
terch-rs chose -ot to continue tc cooperate and began showing 
The Eloctr'c Corpany in school. In all cases when one member 
of a pair of classes vas dropped from consideration its matchee 
was also dropped, and all children in both members of the pair 
were excluc' d from the sample. 

As veil as the forced dropping of classes from the sample, 
there was also attrition due to the normal moving of some chil- 
dren to other schools during the course of the evaluation and the 
absences of some sampled children from school during the testing 
periods. It is, of course, proper to enquire whether the forced 
dropping of classes and the nomal attrition of children froa 
sampled cl^^ses had a major impact on the nature of the sample 
studied in the evaluation. This does not seem to have occurred. 
Of t;ie 10,243 children pretested in 404 classes, 8,363 were post- 
tested in 376 classes. In Richmond some'.v-hat more girls than boys 
ee.rc lest from the study (48.05 percent at pretest were girls 
but 47.7 percent wort, in the final sample). In Washington, the 
reverse was true. Here boys constituted 52.1 percent at pretest 
but 50.9 percent of the final sample. In other categories 
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similarly small changes occurred (for example, in Fresno the 
proportion of Spanish background children at pretest was 49.7 
percent and in the final sample was 50.9 percent). The integrity 
of the evaluation does not seem to have been disturbed through 
attrition, forced or voluntary. 
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Analyses of t he In-school Viewing Experinents 

1. An Overview 

Tne results presented In this section of the report concern 
the two sites of Fresno County, California and Youngs town, Ohio. 
In both sites, pairs of classrooms In grades one through four 
were chosen and one member of each pair was randomly assigned 
to view The Electric Company in school. The numbers of classes 
and of children Involved in each site and some demographic 
information have been presented in the preceding section of this 
chapter (see Tabic 12). 

Table 13 indicates the results of the random allocaLion to 
treat:r.vonts procedure and presents a break out of the demographic 
data by experimental (viewing) and control (non-viewing) treat- 
ments within each site. The population group characteristics in 
Fresno seem ver>' similar for both vie^/ing and nonviewlng groups. 
In Youngstown, a slightly higher percentage of blacks was in the 
viewing group (50.3 percent) than in the nonvitving group (^7.8 
perc^int). Sin^ilr.r kir.ds of sn.all dlf f err-nce^; in composition 
between the viewing group and the non-viei^^ing ,'>roup (usually 
about one to tx^fo pt-rccnt) occur with re=>pect to language back- 
grou::d, a^a, sex, arid target j;roup ir.prbership. None of these 
diff rrL^TVC.j v::.-, ncoricd to ho. r.crious, Hnther they were thought 
of a5 norrnl varintio to be ex^)eclecl botvc.en randorily assigned 
groups . 

Tt should bo remembered that the pairings of classes did 
not involve any in*\nlpulali on of tho monibersliips of those classes. 
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Thus, although the pairs were always within the same school and 
the same grade, the classes were not identical in composition. 
In Fresno and Youngstown, schools tended to be small so that in 
most schools there were only two or three classes available at 
any one grade level. The pairing, therefore, was carried out 
at a relatively gross level, and coinparability of groups rested 
heavily on li..? subjcquer.L ra:**i:*!.ii2aticn of pair r.ier.ibers to treat- 
ment conditions. In short, some minor differences between 
experiner4tal and control groups could be expected to and did occur. 

The in-school vievcing evaluation is regarded as having been 
carried oi-t in separate expsririents in two r,it"S and in four 
grades in each of those sites. The decision to regard the in- 
school vie/;ing study as eight separate experiments was based on 
both logical and empirical grounds. On logical grounds it made 
little sense to combine scores across grades since the target 
population varied from grade to grade and the questions to be 
asked about the effects of the shov varied too. For example, in 
first grade the concern was whether the show helped children as 
they initially learned to read while in fourth grade the major 
qu''iStion wai; whether the show helped poor readers. It also made 
little r;er-sc to cor^bine results across sites because the sites 
were choseii for uheir special, uiiJcrent chc*racteris tics — for 
ex;/ /ic, tho rro.-:io pic had abnut 50 perc. :it Spanish-back- 
ground children and the Youngs toxv'n s^unple had about 50 percent 
black rhildren. Hie decision to keep grades separate v;as fairly 
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obvious when results were seen to differ by grade • Furthermore, 
the intention was to use the pretest score as covariate, A priori, 
there should be differe:.. relationships b^t7.;oen pretest and post- 
test scores across grades due to ceiling effects in the upper grades. 

The cocisicn to keep the two sites separate was reinforced 
when an analysis of variance was conducted using the mean grand 
total Electric Battery scores of second grade pairs of classes. 
Sites, treatment, and pairing were the independent variables. 
A sumrnary of the analysis is here presented. 



Effect- 


cf 


>'o:in sax:i^e 


Site 


1 


116 


Pairs within site 


32 


1088 


Treatment 


1 


7356 


Treatment x Site 


1 


1416 


Treat..r,er.i x Pairs 


32 


271 


Subjects within Classes 


1516 


88 



Nore that treatment effect is highly significant*. Of more con- 
cern at this point is a si^^nificant treatment by site inter- 
action indicating a need to keep the sites separate if a proper 
ur.ch ta-" J of the. efrectc of r-ii^ t r-. al..*c;:t \;o:o. to be obtairi-;;:. 
Kotc finaJJy that the relatively iar^;c pairs williln site effect 
IndiCs'ite^j , as one r.lrht expect, that the pairs of classes did 
differ; the relativel/ small treatment by pairs intersiction and 
subjects vit'.iin cln-ises effect indicat.c'.'> a con^ic:: tent triatinont 
effect across p<.ii^'S of classes and homogeneity witiiin classes; 
the tj;.u\lier subjects within classes eilect indicates the classes 
must be retained as the unit of analysis. 
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The evaluation of the in-school viewing condition is there- 
fore treated as an evaluation of eight separate experin.ents 
involving four grades in two different sites. An overview' of 
the results of the eight in-school experiments is here presented 
as Abstract I.^ The results are based on data from the Electric 
Battery reading achievement test of 123 items (except pretest 
first grade where there are it.::..). Tl.e r^.n pretest, post- 
test, and gain scores for the viewing classes and for the non- 
viewing classes are presented separately by gr.de and by site. 
Further, AV>stract I presents the mean differciv.e bct.-eea the 
gain scores of the vic.ins a.d non-vicvir.s d.sses as well as 
appropriate standard errors of the estir.ates. Finally, each 
mean difference score is converted to an adjusted mean difference 
score by covar>'ing the pretest scores of these classes; and the 
standard error of the estimate of the adjusted mean difference 
score is also presented. Note, again, that if the reader wishes 
to have a .ore co.pr.har..ive vir-. of the re..lts, continued read- 
ing of the report is essential. Ihis section is intended only 



, 2 
as an overview. 



Abr.tr.cls arc presented within the text of Volu... 1 of the report, un- 
like Lhe Vableo which all appear in VoLu::^ 1. 

UV renli.o that the re.der would need, for exa..,l., sia.aard ^^^^^^^ 
scores in order to intci;):c;L_ar>d cc/.;;aie .:.e ^ provide orlv 

p,oyia..d ;;;.:ch .once.tmte on .nea. 

s'cor^raid p'ro^on't ;.ly the nore crucial m.asmcs ol -..p|r.iou._ Ihe 
ta;d;rd deviation i. derivable from the standar. orror S... - S.D. 
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From Abstract I it can be seen that the pretest reading 
scores of the viewing and non-viewing groups are generally not 
very far apart. In Fresno the differences bet^s'een the groups' 
mean pretest scores range from 0.9 in first grade to 5.9 in 
fourth grade. In two of the grades (first and third) the 
difference is in favor of the non-viewers while in the other 
two grades the reverse is true. In Youngs town the picture is 
quite similar, with differences at pretest ranging from zero 
to 5.0. In first and second grades the viewers performed 
slightly better at pretest, in third grade the non-viewers 
performed slightly better, and in. fourth grade there was 
virtually no difference. In none of the eight pretest compar- 
isons (two sites- four grades) was the difference in reading 
achievement between the viewing and non-viewing groups 
statistically significant (p -OS)."^ This further indicates 
that the random allocation of cla<;ses to conditions had the 
desired effect of obtaining coirparable treati-ent groups. 

Abstract I also present" the mean posttest scores and mean 
gain scores of the viewing and non-vicving classes separately 
by grade and by ?ito. The rnean differences (vlev;ing minus non- 



■^Th- s»-a»-<s!-!c used to determine sienif icanco. was the test on the ratio of 
the c'ifferonce v.corc to its stanOard error. I\s'o-tai3cd tests were used 
to determine sifni f i cancc lo-els of- pretest dif f crc-r.ces . In subsequent 
analyses, or.e-tailcd tests are applied to tost the hypothesis that tiie 
experimental trc.tnent benefit.-u th.3 v-i.A.in;.; cL.-.r.e.. . Aithoueh the two- 
tailed test procluceci no siynificar.t prct>.:i: dl ereu^ os at L.ie .05 ^^veJ , 
three of the eight comparisons produced significant differences at the 
.10 level. Hie divergency of pretest score:, is soncvhat };reater than one 
would exi^ect by chance, but only two of the three si };nif icant (.10) 
differences favored the experimental cJ asses. Wiicn classes are broken up 
Into their tarr.ct and non-target ccr-'onenls , differences with high 
probabilities occur less frequently. 



o 



63 



viewing) between the posttest and gain scores are also presented 
along with their standard errors. It can be seen that in seven 
out of the eight experiments, the vicving cla^^scs have a higher 
mean posttest score than the comparable non-viewing classes 
(the exception being in Fresno third grade). 

UTien the gains from pretest to posttest are examined, it 
can be sc. -n that in aU eight e:-n>ar: rents the vi'-^ing classes 
gain r.ore than the non-vieving classes. The standard errors of 
the estimctc of these differences are also presented in order 
to allow iaLei-pretion of the sta-cisLical signif icar.ce of those 
difforc-nccs . 

Since the vie'..'ing and non-vic-.-ing classes were slightly 
different at pretest and since it is reasonable to assume that 
pretest performance is related to posttest performance and to 
gains, the surmnary overview also prosents adjusted mean difference 
scores, i.e., a covariance adjusted score in which the regression 
of the-, posttcr.r r:corc3 on the pretest scores is taken into account 
It can be seen that in moi,t ca&es the adjiyted difference score 
(vie-^'ir.g minus non-viewing) provides a picture quite si-.;;ilar to 
that of the gain score and the posttest score. 

Thvis, as we hnve. seen, there are three estimates that could 
be u.sfcd to coLi-satu t\c eiic-ct of the trentxicnt -- posttest 
scouit, c:iin noorcs, k1 f,.iin srorc.-, with pretest covaried. In 
tlie subsuquent analyses, the covariance technique was deenied Che 
mo:;t precise estimate. In the majority of cases the standard 
error of this adjusted score is sir.aller than the standard error 
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^ of clt' the gain score or the posttest score. Hence, in the 

inic' ^ >: of for-r: tv , all subsequent statistical tests on these 
data will use the adjusted scores (gains with pretest covaried, 
vhicl. is t:.u uquivalont of p.sttest scores vith pretest covaried). 

Tp.e central issue to be addressed from this overview of the 
dat.a if- vh.-'.r iiuUcntions it gives with respect to the effects 
of the s^'W. Tlie ratios of the mean adjusted gain scores (view- 
ing :niiv.:s non-viewins classes) to the respective standard errors 
.J, . , r -t,. 3 Criblit: on that the vising of The 

Electric tomDanjr had a statistically significant positive effect 
(p < .05) on the grand total scores of the classes in all eight 
experiments (grades one through four in both Fresno and 
Young->ta.;n). The effect is largest in the first grade, and 
\^ beccrc:^' £. '21cr in tno hir.er grades. 

Before zovxv.z c^''-to a r.ore detaiied grade by grade presenta- 
tion, a iiLcond general overvie..^ is presented. It will be 
I'l'K^c-^^ i'i"'* Cert: 'P. U'Ur/ot grou*^' are of primary interest to 
Llilr. cvrlx: tier., Tn lirst grade ail children are categorized 

: ... . • r/ '-^ th '.-e. in t-he bottom half on 

nacicnnl "^....i.n- i.Ji:^ aia --.o oaie^ori ; .::id in third and 
fo-.-.:-ih <• fhe children in the bottom quarter are the target 

populaci on. 

v.- ...kpLc-d in fno i-..-i.Dlinj'. plan for this evaluation 

involved Ll.a use of intacf cl;....-.i-5. Th..s, although scl^ools having 
predo!..li.a::Liy pooivf n-r.d.r.s ir.itiaily .-.ppro.-.chod , the sficond, 
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third, and fourth grade classes finally obtained and paired 
usually had a mixture of both tatget and non-target children. The 
first overview of the data was based on the scores in each class 
of all children who had been pretested and posttested. For first 
grade, by definition, this represents the target audience but in 
the other grades it represents a mixture of target and non- target 
children. In second through fourth grades, therefore, a mean 
score for each class was developed for target children and another 
for non-target children (the better readers as indicated by their 
scores on the appropriate Metropolitan reading test). If a class 
had no children in eitlier the target or non-target categor>', it 
and its pair x^ere dropped from consideration for that specific 
an,ily;;is. Note that as the classroom v/as the unit of sampling, 
it again has been retained as the unit of analysis. Note too, 
that cla$s means are not weighted in the analyses by the number 
of children that make up the class meeins. In general this is no 
piobl.ni even though so:>2 clar>i">es had only a few non-targcl no-nfoers, 
Tlu'3e ^roc^^ir^s will be called target components and non-target 
components • 

Aboiracl II prcsenui; tlie sau2 set of information as had been 
prviijc^titvd in tiie first abstract, for target and non-target 
c^»rponentT of classes separately for each grade and site. It 
may be seen that vic^'ing and non-viewing Lar[;et componentj; at 
c:u:h grade level had, on the average, quite similar pretest scores, 
and this was also true for the pretest scores of non-target 
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Abstract II 

v.t; .\:\ Cv Tai^.o: i-et Classes 



Non-viewing 

Viewing nlnus Non-viewing 



S£ of Estimate 



Vf ovlns* 
Non-vicwing 

Viovlng r.inii'^ Non-vlcwing 
SE o£ hsClrcaLC 



VitTwinj; ffi^r.us :.^::-viewing 
S:% of ; sii.Mto 



Fresno Targe t 



Pretest Posttest Gain 



Adjusted 
Variable 



61.4 
36. i 
3.1 



93.8 
8J.2 
10,6 
3.0 



pa** J 

32. 4^ 

7,6 

1.9 



79.6 
c3.0 
-3. A 
3.0 



99.0 

0.6 
2.8 



N'^IO pairs 
19. A 



A.O 

1.3 



N»-ll pairs 



98. A 
94.3 
A.l 
2.6 



109.0 
10 j. 6 
5. A 
2.3 



10.6 
9.3 
1.3 
0.9 



Yo^jnr.r. tovn Targe t 
K»20 pa ire 



j Noi.-vlcvir.c; 
I Sr. of Kr.tirr.itc 



V it wir.v: 
..o.i-vi V 

Viowinr; tnnu*; Son-v lowing 
S.. i. ,L* ...'.<' 



70.4 
65.3 
5.1 
1.3 



9S.0 
90. A 
-1.6 
2.1 



27.6 
25.1 
2.5 
0.9 



N^-IO pairs 



84.3 
o7 .4 
-0.6 
2.0 



100.6 

0.2 
1.0 



16.3 
13.2 
3.0 
1.3 



Fresno Non-'tarj^et 



Pretest Posttest Gain 



Ad ju^* o * 
Variable 



Grade 2 



7.6 
2.1 



93. A 

-3.2 
2.6 



K-10 

IIA.A 
112.6 

1.8 

0.9 



pairs 
21 



1 
••.1 
5.0 
2. A 



Grade 3 



N«8 pairs 



3.5 
1.5 



107.7 


116.3 


8.6 


10*3 5 


U4.8 


6.3 


-0.8 


1.4 


2.3 


0.6 


0.7 


1.0 



Grid's A 



K«8 pairs 



2.0 
1.0 



Cr.;dc 



You nc^stown Non-target 
N»17 pairs 



2. A 
1.1 



GradV 



X"10 pairs 



2.6 
1.6 



2.3 
1.0 



1.6 



115.7 


119.6 


3.9 




116.0 


113.6 


:.6 




-0.3 


1.0 


1.3 


1.1 


0.8 


0.6 


0.5 


0.4 



97.3 


n3.7 


16.5 




96.5 


U2.5 


Itj.O 




0.8 


1.2 


O.A 


0.9 


2.1 


1.0 


1.5 


0.7 



1C';.9 


116.3 


8. A 




IC^.l 


lli.4 


6.3 




-0.3 


1.3 


2.1 


2.0 


0.9 


0.7 


0,8 


0.: 





10 


pa 1 f s 


Crad 




N- 


10 pairs 




3;.:. 7 


110.1 


7.4 




116.1 


11^.7 


3.6 






n '.0 


6.7 




116.4 


118.4 


2.0 


1.5 


-0.6 


0.: 


O.V 


0.4 


"0.3 


1.3 


1.6 




i .0 


* 


0.6 


0.9 


0.7 


0.3 


0.2 



erJc 
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conrponents. As an indication that children were, in general, 
accurately categorized by the Metropolitan Test as target, the 
means of the target components on the Electric Battery are 
invariably substantially lower than those of the non-target 
components • 

The gjir^ rade by all groups of second graders (viewers, non- 
vic'rtcio, target, nou- target, Fresno, and ioungstovn) sceni no have 
been quite sub.? tantial. In each case, however, viewers gained 
more than non-viewers. By covarying pretest scores, an adjusted 
gain score was obtained as had been done for intact class scores - 

Vic;;in3 had a statii.:^ tically sisnificnnt effect (p .05) on 
total score for target second grade components in both sites, 
cad for tc^rget third and fourth grade components in Fresno only. 
i^J For non- target components, viewing had a statistically significant 

effect (p < .05) on total score for second grade components in 
Fresno only, for third grade in Youngs town, and for fourth 
grac'o- CO .pone:)L.y in botii site^. Of the 12 target non-targot 
components in second through fourth grade, eight were statistically 
significant at the ,05 level. The pattern of results is not easy 
to follOT7 if tiie strict dictates of a p < ,05 are observed. 
Kov:cver, in all caches, vicr.>^er5 outgained non-via>^ers . In three 
of the lour results that did not produce si{',nif icant results at 
ti^e .03 itv;.»l, sign!, cance ievcils reac'ned .10. llicsc throo cases 
were non- target co: jponents in Youngs town second grade and Fresno 



Only one of the 14 comparisons reached significance at tlie .05 level (two- 
tailt'O nnJ two out of 1^» reached sii;aif icance at the .10 level. 
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third grade and target components in Youngstovm third grade. In 
only one case (Youngstovm target fourth grade) did the res- its 
show little or no effect. 

The scores of non-target components in third and fourth 
grades seem to have been influenced by a ceiling effect. With 
123 iteins in the battery and a mean pretest score of say 116 
(see fourth grade non-target scores for both sites), clearly no 
large-scale ga^n is available. If the tests represent the 
processes and facts being taught by the sho-^. this would simply 
mean that there is reiativoly less to be lenr.ed by third ar.d 
fourth graders who are reading reasonably competently (those in 
the top throe-qucrters of their grade norrs) . 

It was shown that, taking classes as a whole, statistically 
significant results occurred in both sites in all grades. However, 
when clf.sc^o arc- brokan into a target component and a non-target 
coi..ponent and anaJyses run separately, there is some reduction 
in the proportion of significant positive results. This r:ay be 
due Lo .o; :• lo.. ir. •..•.-.-Lr in thc:t class Tr.e..ns are bn.cd on a 
snaller nurher of .';ubjects, and also to real differences that 
exint the sictj-.. In the two sites ovar the four grados , using 
a target and noa-tar^^c- f b re ,-.kd.r.-n , fourteen conrmrlsons cnn be 

. , . „ , •, .-.^ v.op_,.i- (vir? c3.n=-'>es. Tt w/is seen that 
in ev.-ry ii... '-..nco , a= r.ting for pretest, ' -3 vic.vin.. classes out- 
Cainnd th.' non-vicvin?, classes. Ton of these proved significant 
(p < .O'i) nnd thr>c: closely npproAched t'uis level (p <.10). In 
only or.e cr.-e did Ihe results i:hcn.- Htlle or no effect. 
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Frora the viewpoint of CTV (and one shared by others interested 
in the reading problems of the poorer readers in our schools), the 
target children's performance with respect to The Electric Coinpany 
Is more important than that of the non-target children. In each 
grade in Fresno and in first and second grade in Youngs town, target 
children benefited significantly from the show. However, when a 
class views Tcte Electric Conpany the better readers in the class 
will usually view too. In all components except second grade. 
Youngstown and third grade Fresno, non-target groups benefited 
si£r.iric<:.r»tly. 

In the follov/ing sections of this chapter each of the grades 
will be c.\.':rn.ln2d one at a tiir,e and a coTiprchen<;ive presentation 
made in order to see in which goal areas, in which sites, and with 
which target and non-target groups rl^nificant effects seem to 
be occurring;. Vr:;ethGr effects \n to be related to factors 
assessed in the parent questionnaire, teacher questionnaire, and 
clasjrooni obseivations will also be CKamined. 
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C3 ^ • The In-schaol Viewing Experiment: First grade 

In order to obtain a picture of the specific effects of The 
Electric Company on first grade classes which viewed in school, 
the following tables will be examined: 

— Tables 14a and 14b which present the pretest, posttest, and 
adjusted difference in the gain scores for viewing and non- 
viewing first grade classes in Fresno (14a) and Youngs town 
(14b). 

— Table 15 which presents the xnean percentage of children in 
viewing aad aoii-viG;ing first grade classes answering each 
item of the Electric Battery correctly at pretest and post- 
test in Fresno and Youiigstown. 
— Tables 16a and 16b which present the pretest and posttest 
teacher qc^s tionnaire scales and selected items for viewing 
ana non-vic^.'in^ fia';;t grade classes in Trcsuo (16a) and 
Youngs town (16b) . 
— Table I7a and 17b which present the results of the obser- 
alio.is of reading lo.:^scns in first grade vi^j/ing classes in 
Fresno (17,'j) and Younpr-town (17b). 
— Tc':ble 18.-^ and ICb wh^ch rrescnt the pretcr>t and posttest 
parent ques tiou.iaire scales and selected i tens for vie-jing 
onCi r»o\:-\'ic\ ''.,3 f i : t' gr;:de cln'^:e.s in rrv.'-"-n:} (ISn) nnd 
Youiigstt vn (ISb) . 



o 



o 



Tables 16, 17, and 18 are presented here to provide a full dc^'jcription 
01 Lirst i;rctue clvii>ot.o, hcucver, uisci:..bioa oi iliei^e c.:ic similar tablet 
for ^;rados 2-4 will be pre;5enteJ in .-''ctlon 6 of ihLy> chcjpter. 
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The Electric Battery 

First grade classes in all sites were given a shortened 
version of the Electric Battery at pretest because it was thought 
to be undesirable to give a full reading test to children most of 
whom would be unable to read. The 24 items that were administered 
to first graders at pretest Involved only the matching items and 
.f.on.e sir."l'? itc-^ on cc::s:^r*'jnf and vorc-]?^. All first grade 
classes at pretest were also given the ai:titudo tests and the 
Metropolitan Priner, Part 1, No individual tests v:ere adr;.inistere 

All first grade cia^i^c:^ were given the luii 123-iteni 
Electric B-^rtery at posttest. Tr.bles 14a and 14b present the 
pretext and posttest scores by tests and subtests. Note there are 
four total scores (blending, chunking, scanning, and reading for 
meaning) and from three to eight subtests making up these total 
scores. Altogether for the aohieverient part of the battery there 
were 19 subtests, four test totals, and a matching test that was 
lncliKl>?d both as ea.^y section lo be^ii: the barter>' and to 

discern children witii basic difficulties in perception. 

I 

For eaJv test total and for ea^n subtest a separate analysis 
"as run to test tl\e significance of the diiierence between the 
adjusjted scores of the vie^'lng classes and the non-viewing classes 
Since, In first only a shortened lest v.\:S ad.iLnistered at 

pretcr>t, the toml s< -.re on that 24-iton tc'^'it vas used as the 
covariate for each of tii i adjusted scores. 
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One of the problems associated with the use of many separate i 
significance tests is that one might expect to obtain significant j 

results (p < .05) five percent of the time by chance. The problem ( 

i 

is compounded when the comparisons are ba^ed on scores that are j 

1 

intercorrelated. However, as a first step, the difference be- I 

tween the total adjusted score for each grade In each site for ^ 

viewing and non-viewing classes was tested and each oi the eight 

comparisons was found to be statistically significant. Thus, the ^ 

multiple comparisons within each of the sets of data involvea 

search operation in which an attempt is being made to find where 

the significant goal areas are located after an overall test has 

established that an overall significant effect is occurring. 
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The results of the multiple comparisons within the Fresno 
and Youngs town data for first grade classes show the following 
pattern (N.S. = not significant; * ^ significant at .10 level; 
** at .05; *** at .01 one-tailed indicating positive effects) • 

Fresno Youngs town 

(11 pairs) (10 pairs) 



MiiTCHING WORDS 


N.S. 


ii 


Consonants 




AAA 


Vovels 




AA 


Consonant Blends 


N.S. 


AAA 




A 


AAA 








VrKJe>^ Cnmb Inations 


** 


*A* 


Consonauc Djigrap.is 






Controlled Vowels 


N.S. 


N.S . 


Larfer S-pellin^ Patterns 




AA 


Sight Words 


N.S. 


AAA 


CHu:acii;o total 




AA^' 


Final e 




AA 


Double Cc,v^o::aiit5 


K.S. 


AAA 


Open Syllables 


N.S. 


A 


sca:;::i:;g toval 




AAA 


Morpheir/js 


N.S. 


A>VA 


Linoar L-1c:k*Liis 






Synl ^'icl V'.'i 




A>':^ 


PujTCti'?3tion 


* 


AA 


Contpxl 


N.S. 


AkA 


Context Vocabu''ary 


* 


AAA 


Co".:^' . .... -t/ic^, J 


* 




S on I c.c (' C U'^i' t: i on. i 


N.S. 


A>cA 


rlAdi:»g for ri./jUNG total 










'k'k'k 



The pattern above lndicat.e^; sipiificanL positive effects on 
each lci:i toi..i i.p b.^lh sUcs* T'nc iniiivi-u-jl subtest^"., even when 
producing effcctrs that were not statisticaUy significant, all 
produced eiiecLs in favor of Uu: Vj-ivinj, cJasscs (wilii t!ic one 
exception of the laatching subtest i". fre.^no) 
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Using Tables 14a and 14b which are, in part, suranarized above 
and Table 15 which presents item level data, we shall now examine 
the results for each of the tests in tuni:^ 

a. Matching Words 

This test was not assessing one of the skills taught 
directly on the show. At pretest in both sites an average 
sc jro r:ro than scvon itcTJ^ correct was attained on this 
eight-iter. test. T:\e post test mean score was half an item 
higher c.nd, not surprisingly, the shcv did r.ot seem to 
affect Lhe childi'::ri's ability to t.^l'^li. ;;urds • 

b. B'^o"^''r" Total 

Thif; Lest cc:-:£:isted of 28 iter.3. All items were 
adT.inis tered at posttest but only 13 were administered at 
pretest. There were three subtests that made up the Blending 
total. Tarse were consonants (13 iters assessing the child's 
knowled£;c of single consonant sounds), vowels (six items 
as.'iC f thr c:ii3 '*g knou-'lc' -e of vrvel sounds), and 
consonant blends (nine itev^s riSocssin^, t'.:o c^*ild*s knowledge 
of f>uJi bcig'Tii'ilng .Viid ending Cv;n3o:.r...t bJe/r.ds as "tr " 

and " n.<") . It should be noLcd that wiiiie the first two 

subto<-rr, conno^ants and vowels, nre not strictly blending, 
they icprc.^mt i^vecuisor skill?: mu! -..^cmv ir.cluded by CTO 
unc'C r M v- r.--"- r.r. - their sori1<? - t'ltr-^-nr . 

A provisos a coiuplctc lib ling of the go.ilr. Ti;^' K loctric Co^ np-^-y. 
:. h providt's a detailed description ol. the ter.ts, including ^a 
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The content analysis it.Jicated that 19,5 percent of 
the shar was spent in this goal area, Tnus the goal area 
vas c.nparently given both nominal and actual emphasis by CTW\ 
Further, from a curriculum viewpoint, this goal area was 
clearly one most appropriate for those children in the 
early grades beginning to learn. 



An abstract 


irora Tables 


lAa ana I4b 




Adjusted Differenc-i (vier^^'ing ninus 
non-vf er^np"^ Scores oi Blendinfr Subtests 








Percent 




Fre<?no 


Youngs town 


of show 


Co r»s 0 .1 1 1 1", 






9 . 2;-; 


Vov;c» Is 






2.0 


CoiiiL/onant lilends 


>2 




_5JL 


Blending Total 


1.3* 


1.6*** 


19 ..5% 



(Asrerisks indicate significance levels as presented in the 

prcci.:l:n:; talkie) 

It is noteworthy that at postteijt: the r.ean score for 
the r. :.'V ''.'^ c3r.xscrt vr.s about 21 Itcnr; correct out of 
tlie 28 itrr.a. Tnus, while there was room for a diiierentif.x 
i:-. -ow ..t ; v vicvi..? cl-^rr^.' , even in first r^<''-^^ sore 
cci^i:-.- effccu wr..s in evivl'^ucc, especially in the consonant 
' v.brcrt vho.rc at pontter.t the typical percentage correct 
for non-vit'.v'crs v*'iS in the lov ninciios. 

V!:. r!"'Lr:c ta;/nt n v^ivioi^' of readi.iii; 

skiil<; v;:iich had different levels of difficulty. Knowl- 
edge 01 coiuouautJ .,ud vrv.-t'l'^ v.... in liu- Iv-.s difficult 
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ran^e, yec for first gradu-rs who viev.*ed in-schcol these two 
areas were effectively taught by the show. In Youngstown, 

cor/CT. int blcndi; rc also ef feet ivoly t.-.u^/nt. 
Chunking Total 

Tnit test consistod of 28 iters divided into five subte? 
Vowel Coiriinations (9 items) e,g, , "ou", "ea" 
CoTisonant Digraphs (6 items) e,g., "ch", "sh" 
Controlled Vacels (4 items) e,g,, "ar", "ir" 
Larger Spelling Patterns (5 itens) e.g,, "all", "alk" 
S:"*^r VJ^^^r. (4 iters) taken fro-^ a list of those 
taught on th3 shofw. 

The goal areas assessed by these five tests were strongly 

emphasized in The Electric Company and constituted 25.4 

percent of the show. 

The d'-^^ra'-i cf effectiveness x:ith which these goals were 

traj^ht is evidenced by the following abstract from Tables 

i4a and 14b . 

non-vlcirin"*) Scoj:c9 on C riiinking ^^jbtests 

Percer. 





Ttc'r. '< 




of f- 


Vcv.-1-j Cc: l/inctic.:3 


. 5*« 




6.0." 


Co rs- ov.r.v.t D * f r r. ph s 


.8*** 


.8*** 


3.5 


Coii trolled Vo-..'e] ■ 


.1 


.0 


1.6 


I. ■'.!.. f-; 'll-i-.i^; .''.l !orn5; 




.6** 


3. 3 


Sij;iit V."ords 


, 2 




10.9 


C.':A:u\:iU(^ ToL;!! 






25..'- 
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Only in controlled vcvels were there no significant 
results in either site* Note, however, that relatively 
little time was spent on the show with that goal. It was 
also the hardest subtest in this goal area in that at post- 
test the mean percentage correct was about 40 percent (25 
percent boing chance level) • 

I;i Vw.:^.l. ccrLli^aLioro , consoivant digrapiiu, aad larger 
tpellir.g patterns, both sites shwed significant benefit to 
the first grade viewers over non-viewers. Inspection of 
the item level data (see Table 15), indicates thet on the 
20 it-::.:.-; i.\ ci.ose i;.r:e suhtCiSLs, viewers perforr.od as well 
or better than non-viewers at posttest on 17 items in Fresno 
ani on 18 i teirs in Ycungstown* The largest difference seems 
to occur with one item in consonant digraphs — "ph" (a 20 
percent differential favoring viewers in Fresno and a 43 
percent cifferentisi in Youngs ta-;n) * Tnis digraph is not 
nor.-.^.j:.y t:'.^ht in - ir.vt grac^e so that itere the difference 
is probably bet\:cen being taught by the sha^ and not being 
Laug'.it at all. Wieh an item such as "th" tlie observed 
difference in scoio? Is probably pritr.ariiy between being 
tr.r./lit bv th^* tcacii in school and on the shov on the one 
hand versuij being taught only by the teacher in school. On 
th- "i:/' il*-:*. tl ' vi. ^K'V: v.-wj favor-. <\ p.;,^LLo.^t by six 
percent in Fresno and fourteen percent in Youngstown. 

Ihc night word; area was as5CS5;cd by a four*-item test 
that suf force: by virtue of the fact that the listing of 
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sight words to be taught on The Electric Coiitpanv was not 
available when the test battery was being constructed. A 
sizable amount of time on the show was spent on sight words 
(10.9 percent) but the fr • items were not a representative 
sample of what was televised over the six months. The words 
"Avenue*' and "elevator'* seem to have been well taught by the 

'V. vjnue" v:r.£ part of an of ten-repoated song, and 
"elevator" wr^ featured on an animated cartoon. An 
approi'iir.ately ten perceut differential favoring viewers was 
obtZolxiC'C on thoiie two words. 

In fcr.aral, r^e chunl:ing goal areas were effectively 
tau^i.t by the shov to first grade, in-school vie^^ing classes. 
In the t^:o sites combined, viewing classes obtained an average 
of 2.3 r.ore items correct out of 28 at posttest than their 
non-vier.ving pairs. 
Scc:nnirf' Total 

V.\'li- test con'*-ist:ed of 14 xtcrc? and war; used to assess 
a child's ability to attend to structural properties of words. 
ThrcG s\:b::ests were developed: 

1-innl c (6 iti,i;.s) e.g., mate vs. mat 

Double Consonants (4 itenq) e.g., dinner vs diner 

Cvc::i SyI3Ll>lej (4 ite.:-;) e.g., he, go 

71. c :.:cv:l ;ii : r.'yiMjr-ticd bv those three subtests were not 
strc;n^:,ly o:i:phasized on the i;how (about scvt:n percent of the 
tir.e) . Trio e feet of first grade classes vir^ing in school 
roiiy be seen from the following abstract of Tables 14a and 14b; 
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Adjusted Difference (viewing minus 
non-vicvinR) Scores on Scanning Subtests 





Fres no 


Youngs town 


Percent 
of shoy 


Final e 


.7*** 


.7** 


A. 5% 


Double Consonants 


.1 


.5*** 


1.7 


Open syllables 


.1 


.2* 


0.9 


Scanning Total 


1.0** 


l.A*** 


7.1% 



Tne open syllables subtest results indicate that this 
skill was not influenced greatly by the show. Note too that 
less than cna percent of the show was devoted to that goal* 
Most tir?.e was spent on teaching the final "c" and significant 
effects were noted in both sites. On each of the six items 
viewing classes performed better than non-viewing classes at 
posttest. In Fresno, this difference averaged about nine 
percent r \i in Youngsta-^n about ]6 percent- 
Less clear-cut were the results from the double consonant 
subtest. In Youngstown, a difference in fav*. of viewing 
cl:\<'i •» **ns clearly ciscemable but this was not so in Fresno* 
However, in each site the double consonant items proved 
quite diffic.ilt for first graders. 

In general, the item level data reflect the results shown 
in the r,v. ■ tcrblcs. Scanning, as the ter- v:ns used by CH-J, 
v;rts a difficult- Miill for first graders and even when 
si^rniflcant results were obtained, as in the case of the 
fin.-*.] "e*\ nbotst 50 percent of the children in the vicswing 
cln.';s'AS had not attained the goal. We shall, of course. 
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return to these saine goal areas as we move up the grades • 
Reading for Meaning Tota l 

Inis was the largest cf the test totals consisting of 
45 items. The nuinber of itens reflects the overall goal of 
the shov which was to insure that children comprehend as 
well as decode. Tnere were eight subtests to assess this 
gonl c^ren. These were: 

MorpheT.es (10 items) e.g., endings of words — ed, -'ng 
Linear Blending (6 itens) reading and comprehending 
scnterxc^s 

Syntactic Unit^ (7 items) to derive meaning of a phrase 
Punctuation (5 items) e.g., ? , ' 

Context Total (9 items) Difficult or ambiguous words 
are used in sentences whose context give meaning 
to tlie v:ords . 

Context Vocabulary ♦ Four of the vocabulary words alone 
are presented to see if children know the words 
out of context. ViOt part of context total above. 

Contort Sentences. Tlie sr.nie vocnbulnn^ words as above 

:;ru L' i:: scr tencc:-; » Part of Context lolal above. 

Senle:ice Questions (8 itorts) Typical x'eadmg comprehension 
questions boscd on one oi' ti^'o f;entonces. 

The goal ar-^as assessed by these subtestf: were taught 
on the shc'.^ al>out 21 percent of the Lime. Obviously, ho\^cvo:', 
any improver.ent in the child's ability to decode words is > 
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likely to have a positive effect on that child's ability' to 

read for r.eaning. In us, the percentage of the show figures 

below reiaLe to direct efforts to teach the skills (for 

example, sentence reading, punctuation) rather than less 

direct efforts to promote comprehension. 

Ti.e effect on the reading for meaning subtest for first 

f^racc cJ • '^r.^ v:''::-^ i:\ scVcoI r.av be seen fron the follov- 

ing abs'.ract of Tc:^]e^. 16a ?.nd'lAb; 

Auj listed Difference (vic^./ing rlnus 
non-viewing) S cores on Reading for Meaning Su btests 





Fresno 


Youn_p«:to7%''n 


Percent 
of shew 


Morprv?:* 


.0 




4.7% 


Linear blending 






9.8 


Syntactic unite 


.2 




0.2 


Puncfucxtion 


,2^ 




4.3 


Context total 


.3 




2.2 


(Vr>c;v'^ul rrv) 


.2* 






(Sentences) ^ 


.2^- 






Sentence qucstioiir. 
Ro a u i n p. for ^^niil n r 


.4 

totnl TTS 




not 
directly 
Lau^ia t 
"21! 2% 


At this poiwt 


effort to intcap 


ret, \;}iy Youngsco'.;n first 




10 !icvc hen 


efi to.! ic;v: f i 


c; r.t'lv 


r'^vo th<-:n Trc^Mo on 


fht'»ro i^o.iL; \.'ould 


:ocr: to be in 


ortier. A 



fir.:t reaction inight be to coasi.iler the nttr.inmont levi-ls of 
^Scnt.onr.^'-, i<> a :ubte'St of TiiC Conrox'; Total. 
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the first grade classes in the two sites — perhaps the goals 
arc. rori^ aopr^^pri nte for one level o f at tainntant than for 
,another- Unfortunately for that theory the scores of the two 
sets of first grade classes seem to be remarkably similar. 
Likewise, as shall be seen later in this section on the first 
grade results, other factors such as teaching styles do not 
seei to be heavily implicated because site differences do not 
seem to be extensive, 

Or.o fact that should be kept in mind was noted in the 
overviews of tiie data presented earlier iu this chapter, 
Wuile first grade, rather than second grade, in Youngs town 
provides the strongest evidence for the efficacy of T.\e 
Electric Compa ny , the reverse is true in Fresno* As we look 
at othor analyses an attcnpt v/ill be made to tr/ to uncover 
sor.e possible vccisons for these difioronces, 

J, ^'iflPiU > O ^ JL 

llie difference at post test bet\%^een first grade viewing 
ciasse:s and tiicir iion-vi ing pairs, vith pretest covaried, 
3.6 points ir. Fresno end ]0,2 pv^iiitrs in Youngstown, In 
hoi'. 5 I'.r: difference is s tati^ ti ca 1 Iv sir.nif icant. 

Of considerable incerc.->t is v.hcither the differential 
in {a\ur c^-i vicv;;:',: cl ..r-> c.v:: f >\ n i U rr- ^ho^e con- 

•-nt '..•n. U:!V(:ll> 'it (/n /.u-.: (exact hl^nd or exact 

•./oi'd uju'd, for exa::ple) vciic tlier the differential came 
frorj iu; . *. •cjni'ifl w^. ::ot dirrcrjv r;uivht on tiie 5;hn^•. 



1.0 I 



I.I 



.25 



145 12 8 
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S32 
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An example of this latter kind of item would be where the 

exact word used in an item to test a blend or a consonant 

was not actually taught directly on the show. In this c e 

the item could be -answered only by the transfer of knowledge 

gained from the show or elsewhere. 

In order to look in detail at this question, two groups 

of 32 ite:r3 were selected from the bat:ter>-, one group being 

the show specific itenis and the other the non-show specific 

items. Care was taken to insure the t\-7o groups of items 

were of comparable difficulty at pretest. Tne results of the 

subs>equent analysis on first r,rade scores are here abstracted 

Adjusted Difference (viewing minus non-vievving) 
Scores on Speciiic and Is'on-Specif ic Subtests 

Fresno Youngs town 

Shw specific iten9 l.T^^* 2.6*** 

Non-show L-peciTic itonis 1.8** 2.7*** 

It would seem that, for first grade classes, the effect 
of the show was as larj^c for the non-show specific itemr, as 
for the siiow specific iteuis. Waat is being learned ic not 
sinr^lv rote recall of specific words taught on the. show but 
includes skills the child can trr.nsfer to rr.-; words and 
situations . 
The IndlvLciujl Tost : 

A:; well as the group test — Tne laeciric B;ittery — crA 
individually ad;:^ini5. tcred reading test of 36 items was given 
to a randonly selected 20 penxp.t snriplxi of each cla..s (onlv 
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at posttest In first grade). The individual test assessed 
many of the goals assessed in the group test. 

Over all 36 items, the results proved to be significant 
in Youngs town but not in Fresno. The adjusted difference 
scores betv;een viewing and non-viewing classes wera: 

Individual Test 

Adjusted c'.ifference 1.3 5.3*** 

It should oe noted that this individually administered test 
tended throughout the total study to provide similar find- 
ings to those obtr.incd Croi?. the c^o-P adr.inistered Electric 
Battery. It is instructive in this respect to look too at 
the iten analysis data for the individual test (also contained 
in Table 15). These data show that certain items were too 
difficult for first graders (e.g., ''oi"). Others i^ere rather 
easy (e.g., "pi") and others discriminated well between vie-w- 
ing and uo:\-vi Q\: L\ z clc^ses (-^-g*, "ch" av.d *'st*'). 

The individually administered test contained two subtes^o 
not incluJad in the total score ~ left-right orientation and 
scrambled r,Gncences. No significant effects of jlie Electr ic 
Cor^> j" werci noted for the left-right orientation tc^t. With 
scra.ii)ic,d t^cntcnccs, the task for tae cljLldr-^-n was to put l!iC 
wo;<!.; a ir.r.fiil order. This r.ent'-'nrc unscraribl ing 

activity occurred on the sha>; 1,5 percent of the time. A 
significant effect wn:> noted in Youngstown only. 
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Attitude Tests 

Two attitude measures were administered as part of the 
Electric Battery. The first of these assessed the children's 
attitude to school. It consisted of nine items in which the* 
child indicated positive or negative affect in relation to 
various school situations using a happy face-sad face 
technique. In Fresno no effect was noted — the vie^/ing and 
non-viewing classrooms showing similar small gains over the 
six months of the show. In Youngs town, the effect was 
significant: 

Vie;;ing Non- viewing 

Classes Classes 



Pretest 7.2 7.0 

Posttest 8.1 7.6 

Adjusted difference .41 Standard error .16 

Ttie second of the attitude tests was an ipsative- type 
preference ter;t in which scliool subjects (reading, math, 
socl::l f,:t:dlc9, art, and spelling) vrere paired and the child 
indicTted a preference. The crucial score for this evaluation 
wii-' \ \ j\ idi/rg ,>:*c-r;'rcnco scores Since it was paired with 
eacp. Di uhe other subjects, n maxini'jm preference vould be 4#0. 
In Yoimfistcvn no sL^nif tc<3nt effect wns noted between first 
grade viewing c : non-vi(fv;ing classes. In Fresno there was 
a JUfn.ificant ci'T.vct 'avorinj; the viwing cianses. 

Thus, vith tlic two attitude teSuS in the two sites, four 
sla-wioiical tei;t:i; were calculated. In two of the four tests 
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viewing classes were signiticant.ly positively affected and 
in the other two instances no significant results were 
obtained. 

M etropolitan Tests 

At pretest, first grade classes were given one section 
of the Metropolitan Primer Test and, at posttest, a section 
of the Metropolitan Primary I. While the main purpose of 
the test was to enable the designation of target children^ 
an analysis was mdertaken to see if viewing The Electric 
Co-:vv.yy had an effect on the viewing clashes* mean score on 
a standardized, noiT.^.ed reading test. The pretest Metropolita; 
raw score was used as a covariate and the non-viewing classes 
as a control. No significant result was seen in Fresno • In 
Youngstown a significant result was obtained as this abstract 
indicates : 

Metropolitan Raw Scores 



Viewing Non-via; 1- 

?rotc>5a Pri::K^r (39 iterrs) 23.2 20.8 



18.5 



i-i!.?.ry 1 (35 ito-...-j) 23.3 
Adju..l-3d Giifercnce 2.29 Standard error l.O'. 

Thus in era' f-ite vhcro Th£_rX5.?iJl£J^^'I!Il.'i^ to be 

having the r.rcatcr effect viUi first grade classes, it also 
afu--t.,'d por/oi..-.aP.;e on a standardized, norrncd reading achie- 
n-.Gnt terjL that, obviously, was not itself constructed to asse 
the goals of the sliw. 
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The previous pages have presented the results in some 
detail for the in-school viewing experiments in first grade. 
In succeeding pages the results for second, third, and 
fourth grades will be presented. The task of retaining 
some prospective on all these data is not easy. Perhaps 
the inLrocuctory overvie^^" is worth returning to. ^'ote too 
that in Chapter 4, a summary of these more detailed results 
will also be presented. 



8^ 

The In-School Viewing Experiment: Second Grade 

The second, third and fourth grade experiments are virtually 
the same as the first grade experiment described in the preceding 
sections of this chapter. The only laajor difference is that the 
first grade classes were given an attentuated pretest battery 
but the second and higher grades received the full Electric 
Battery at pretest. In order to obtain a picture of the specific 
effects of The Electric Company on second grade classes which 
vie^>'ed in school, the following tables are examined. 

Table 19 whicii presents selected pretest and gain score:. 

of vie^^ing eind non-vie.>^ing pairs of classes in Fresno which 
were dropped from the study. 

Tables 20a and 20b which present the pretest, gain, and 

adjusted gain scores of the viewing and non-viewing second 
grade cl.^sses in Fresno (20a) and Youngstovn (20b). 
Table 21 which presents the mean percentage of chil- 
dren in viewing and non-vie;-7ing second grade classes answer- 
iiip. each item of Lhe Electric Battery correctly at pretest 
nnd pc>r.ttcst in Fresno and Youngs town. 

Tables 22a and 22b l^'hich present the pretest ftxxd post- 
test teacher questionnaire scales and selected items for 
vi-...Mjj^ ....'J ;u,n-vi tvin^^ second gradt* classes in Fresno (22a) 
and Y^^Osir-Blwv. i2?h) . 

Tables 23a and 23b which present the results of the 

obrervntion'5 or reruHnp, lesiJonr. in r.econd grade viewing 
clai^soi; in Fresno (23a) and Yuungstown (23b). 
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Tables 24a and 24b which present the pretest and po.'it- 

test parent questionnaire scales and selected items for 
viewing and non-viewing second grade classes in Fresno (24a) 
and Youngstown (24b). 
The Electric Battery 

After the data had h^en collected it was learned that random- 
iz:.::ion in rAx paiis of second grade classes in Fresno had not 
been correctly adhered to. In these pairs, all six control 
classes were in different schools than the six experimental 
classes. Although the schools seemed comparable (similar sending 
areas — clfTcrcut school hxis routings), the control T.erbors were 
in sdiools that were not yet connected to the closed-circuit 
television system. TVius, although the assurances that the schools 
and classes were similar seemed to be borne out by the data, the 
six pairs Vs-^re dropped from the study. Table 19 presents the 
results for these six pairs. Note that the grand total pretest 
v,o.y.\r> for vU :i\.g L^d ncn-viewing pairs are very si::dlar (85,6 
and 85.7) but the variances are not (the standard deviations are 
11.9 and 6.6 respectively). Differences in gains were in favor 
of tl:e viewing clar.ses both on the group and the individual tests* 

T\\c proper procodurt? for randor.ir^ation was not carried out 
in every instance in cho jocond grade in Fresno because double 
the nu:r.bex" of paired ..'.n ^srooii^s \:c.r, needed in .second grade and 
in order to obtain 40 classes in a site where schools are widely 
dispersed goo^rapliically , control classes were selected from 
fjchools where there was no television system. As a result of 
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these factors, the six pairs have been omitted from the F.njor 
analyses • 

The following results for second grade are based on 20 pairs 
of classes in Youngs town and 14 pairs in Fresno* As in the first 
grade, a separate analysis was run for each subtest to test the 

significance of the difference betvs^een the adjusted Tr4ean [raias of 
the vicvin^ r.c-n-vie/ir*^ T-,:irs of clasi^cs. In this c:\se, the 
approprictwa protect score wc.3 covaried for each subtest separately. 
It can be seen that when tests and subtests are considered 
separaueiy ior each site, (see Tables 20a and 20b) a patteni of 
rt?i5?i:cnl ^r'.r.'iiflcnncct occurs. In sur^.^3ir,': 
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(N.S. = not significant; * = significant at .10 level; ** at .03; 
*** at .01) 

Grade 2 



Fres no Yo ungs town 
(lA_j>airi) ( 20 pairs ) 



M/,TCHIKG WORDS 




N.S. 






IN • O . 


Vowels 


N.S. 


N.S . 


Cor^orrir.t: Rlends 


-1- 




BLENDING TOTAL 




M C 

r< .o . 


Vowel Combinations 


*** 


N.S . 




A .t- vt, 
X .% ?, 


ii A 


Ccr.trcllec! Vo- .-^l^ 




^^s. 


Larger Spelling Patterns 


*** 


N.S. 


Si ;ht Korcy 






C^iU^!*'T^ • TOTAL 


*** 


* 


Final e 


*** 


*** 


Double Consonants 




* 


Open Syllables 


** 


N.S. 


SCAMPING TOI.U. 




* 






* 








Syntactic Units 


N.S. 




PmcriiaCion 










N.S. 










N.S. 






* 




RrJADTNG r0:< mi:.'Ui::g total 













0.\'.alij the re-;\ilts of the total Lost were iugnificant in 
ho\:\ '.'tc^. r TK^iu-tod ['nln (vicwir.f: r.iniis non-vi e^^ing) was 
5.8 po'n:^. in rionio . id 2.2 poi :Us in Younf.:;tovn. Tiie ciiccCs 
seem a little loss strong than for first grade. In general, sub- 
tcstr; that :;cr.- .si ?'ni f a cant in Younf;r>town were alr,o significant 
in Vr.-u-.vo. Ik.-.H-vor, since the Fr^-sno nisults were raore positive 
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than Youngstown's in second grade (the reverse of first grade), 
there were slf;nificant results in Fresno that were not replicated 
in Yoiingstown. 

The bl(>ndlng area provides only partial evidence of significant 
effect but it is also an area of general competence for many second 
graders. It is the chunking goal area that accounted for most 
of Fresno's viewing classes' larger gain than Youngstown's . 
Fresno's second grade classes gained considerably from the show in 
the chunking goal area but the results in Youngstown were less 
positive. Xhis reverses the pattern noted in first grade where 
Ycungstovn classes benefited from the show r.ore than Fresno classes. 
N'ote a^ain, hc./cver, that the YoMngstown classes perforr.ad bettor 
at pretest in this area and had less to gain from the show. At 
(^y pretest for chunking, Fresno classes had a nean score of 12.^ 

01. t of 2S ize::s vhere..^ the r/^an for the Youn-?tovn classes was 
nbout 1A.9. Tills point is perhaps most clearly made when the ite-. 
levo.l data are consulted. Consider, for example, in the larger 
si.ci:ir.g p.^uorns subl^^ly the ilex te.it:ins£ll Cis in (h) all. In 

F yo *; no Youn • town 

Mean pcrccat<\;c correct Vic.'ing Koii-vicving Vi(r./ing Kon-vie;,7ln5 

. 6A;i 6/i% 86% 85% 

91 83 95 90 

Tne Frcsro clr,sse3 started over 20 nerce.ntaj'e points lower, and 
r!^v> vw/.;i:v- rl-^vrc-r. h,':cl n di f f crcTM* j al j'ni n of olpjit porcontap.e 
putr.li* while the Youn,>lo,;n vir.;ing cla,sscs had a differential 

/ 
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O 



Gain 

Adjusted 
(viewing 



gain of half that ar^ount but at pretest already showed an average 
of 86 percent correct. 

In the scanning goal area it is the final "e" subtest where 
results were strongly significant in both sites* Here are the 
item level results on the six items: 
Fresno 

'^Pretest Post test 



Youngs town 
Pretest Post test 





Vic-.; 


Kon- 




Non- 
Vic.-; 


Viw 


Non- 

Vi B.J 


View 


Non- 
View 


t c- 


39% 


'. 3 % 








•50- 






no^te 


40 


51 


80 


71 


52 


51 


86 


81 


cono 


37 


39 


74 


56 


41 


37 


72 


63 


kite 


51 


55 


91 


72 


69 


60 


90 


85 


robe 


12 


12 


50 


27 


17 


16 


50 


31 


ti re 


46 


/.o 


fO 


62 


45 


41 


76 


68 



Clearly the sVjrrit "a" is a goal area in •.\nich the show benefits 
second grade c' asses. 

In tho j^.^!.ir.^^ for :.2c.i\±i.% area Li»G royults tenct^d to 

be }i'">vti po^itiVj- for Voun-^^^ t.c.,s?n thrn for Fro.^no classes. Interest 
inj^x}-, I'r.ii) v; l\ic h;ird._;t i^rox:;^ of ilc::\ in l::^ batCi^r^'* Tne 
subiesl. tiicLl provided significant resulLo in bolh sites was 
P'juc':t\ iJon. T:-s.: rc-ulrf. of this five itrni ^u:''COf;t are: 

Vicwj iv^ llc:r \-L(sj. V Lcving Kcn-viev; ^ 

1.5 1.4 2,0 1.8 

1.4 0.8 1.2 0.7 



di f f cronce : 

minus non- viewing) 



.63 

(SE.14) 



.59 
(SE.17) 
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In both sites the results of the show specific and non-show 
specific groupcJ of items were similar and significant. Th\is, as 
in first grade, the impact of The Electric Conpany went beyond 
the actual examples taught on the show. 

The results for the individual tests were similar to those 
provided by the group tests. The effect of the show as assessed 
by the individual tests was stronger in Fresno than in Youngs town 
and the areas of impact seem to be much the same as those described 
by the group tests. No evidence of attitude changes, as measured 
by the f.:o atwitudc scales, was noted. Similarly non-significant 
was the linpact of the sha.v on the Metropolitan tests used for the 
second grade cV.s^oes. Differences here were small, favored the 
viewing classes, but were not larger than the respective standard 
errors. 

* * * 

To this point we have examined the data from second grade 
classes viewed as a whole. However each second grade o.latis can 
be th./'Vr cf C3 hr.vlnc; a turret con^ponent (at or below the 50th 
centile on national reading nonrs) and a non-target component 
(above tr.e 5Cw. con'J.ic). Tnc following section of the report 
will o>:.i iv.t tne in-schooi viewing experin;ent for second grade 
c].%r>i'Or> ri xrr.t: t!ie tnr^^ot from the non-tnrpet component. 



Tr.reot nnd N'on-T argot Components. S econd Grade 

Accorcilr.g the stated priorities of CTO, T2iejn^ri_^Con?oar^ 
was to focus on the reading problems of those children in second 
grade who were in the bottora half of the population on national 
reading norns (the target group). At pretest, all participating 
.ccond grade classes were adir.inistered the Word Knowledge subtest of 
the Metropolitan Achievement Test, Primary I. On the basis of the 
results of this test, children were assigned target or non-target 

. . . -o~nibif to calculate the means and variances 

of the target children and the non-target children for each class 
separately. Where a class had no non-target children, that class 
and its pair were omitted from consideration in the analyses to 
reported in the section. 

Fron. the overvi:.. (see Abstract II) it was seen that the results 
for the total battery were significant (at the .05 level) for both 
tarcet and non-target components in Fresno and for the target 
^-..^,.,.-.r- v,v:-v -.tcT. Tlie non-tars;er component in Youngs towi. 
.".ISO shoved cffc'cts of the show but the significance level fell 
l,<i-,.-: -n .05 r.-r.:. .!( . 7-; e'.-s'ract: 

.islco :>: ;':'ori-ncc (vic.-ir;}; :.-.inus no;i-v: Cv-ing 





Co: 




Fresno 


Younj;s town 




SE 


Mean SE 


Target 


2.1 


2.4 1-1 


Non- target 


1.0 


0.9 0.7 


lu both 5;ite« the impact in second 


grade 


appeared to be greater 



lor target than for non-target components of the sample, (and 
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significantly in Fresro). The follou^ing presentation lays out the 
size of the impact for each component in each site by each of the 
tests and subtests. This presentation is an abstract from Tables 25a 
and 25b (target components) and 26a and 26b (non-target components). 
(N.S. = not significant; * = significant at .10 level; at .05; 

at .01). An X indicates significance favoring the non-viewing 
classes. 

Grade 2 

Target Non-Target 

Fresno Youngs town Fresno Youngs town 
(14 pairs) (20 pairs ) (10 pairs ) (17 pairs ) 



MATCHING 

Consonants 

Vov;els 

Consonant Blends 
BLEEDING TOTAL 

Vowel Coribinations 
Consonant Digrn-hs 
Coucrolled Vraels 
Larger Spelling Patterns 



Double Consonants 

sc\\.::t:G total 

^.i :>'*ar Ul end: 
Sv*-!fncti c Uni ts 
Tunc tuat ion 

Co., I o :•; L Vo c u 1 a r y 
Context Sentences 
Sentence Qucstionr, 

;<;:Ai)i:a; im MiZAiaNC total 

Ci AM) total 





N.S. 


N.S. 


N.S. 




N.S. 


N.S. 


N.S. 


N.S. 


N.S. 


X 


N.S. 






N.S. 


N.S. 




N.S. 


A 


N.S. 


iiicic 


N.S. 


N.S. 


* 




AAA 


A 


N.S. 


A** 


A 


N.S. 


N.S. 




K.S. 


N.S. 


N.S. 




>';AA 


7.7 C 


N.S. 




N.S. 


* 


N.S. 




AA 


** 


N.S. 




A 


N.S. 


N.S. 




N.S. 


N.S. 


N.S. 


AAA 


A 


N.S . 


N.S . 




AA 


N.S. 


N.S. 


A* 


AAA 


N.S. 


N.S. 




AAA 


N.S. 


N.S. 




ik >\ >V 


N.S . 


N.S. 


K.S. 


N.S. 


N.S . 


N.S. 




AAA 


N.S . 


K.S. 


A* 


AA 


N.S. 


N.S. 


A 


AAA 


N.S. 


* 


A* 


AAA 


N.S. 


* 




AA 


** 


* 



In general the abstract shows that it is with target rather than 
non- target second grade components that the show has the greater impact. 
Specifically, target children in Fresno seem to benefit in all the 
major goal areas. In Youngstown the target children seem to benefit 
most from the more difficult reading for meaning area. Note, however, 
that the target group in Youngstown seems to consist of somewhat better 
readers than the target group in Fresno. At the subtest level, very 
few positive results can be seen for the non-target children in either 
site. One reason is that the non-target children obtain scores of 
almost 80 percent correct at pretest and over 90 percent at posttest, 
and there is sin;ply not a great deal for non-target children in 
second grade to gain on the tests. 

It may be remembered that the sampling plan for this research led 
us to look purpot>£ly for schools and classrooms where target children 
would predoiTdnate, Thus in looking at the results that have been 
presented in this section, the reader should keep in mind that the 
target component of each is generally much larger than the non-target 
co:..;ja:icnl:3 . Xr.us : 

Mean CJ.r<ss Sizes of Tart>et and N on-Tarp,et Components 

F r or> no Youngstown 
Vicving Kon-vie-zing Vievv^ing Non-viewin 
T. : 13.9 16,9 15.8 16.6 
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* * * 

Overall, the shov was seen to be effective in second grade. When 
classes were divided into target and non-target components the show 
appeared to be n!ore effective for the target components, Hils was a 
hoped for result in that CTW had planned the show with primarily the 
target group in mind* 
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The Tn-Sch ool Vi^^in% Experiment: Third grade 

The overviews of Lhe in-school viewing experiment (see Abstracts 
I and II) seemed to show a lesser impact of the show in third anc 
fourth grades in ccmparison to first and second grades. This lesser 
impact was not so much a matter of failure to obtain statistical 
sii^rdficance, but one where the size of the difference between the 
^JiliiG c: vlcving c.p.c ncn-vieving clc^ss^s vas relatively small. In 
oLher vovd3, the viewing classes gained more than the non-viewing 
classes ua the total battery and this differ^^ncc ii\ gair.s is believ- 
able (statistically signiiicaat) , but it is rather si::all nonetheless. 

The rcnson for fhe srall differences is quit^t clear— by third 
grade the vast majority of the children have most of the knowledge 
and skills being tested by The Electric Battery. For example, they 
know their letter sounds, they ,cnov7 simple consonant blends such as 
'*t:r" and "pl'\ and they can get meaning from simple sentences. On 
the 123-itcn pretest battery, third grade classes on the average got 
^,11 but obrwt 28 ifo. *r. correct and fourth ^rade. classes all but 
about 18 iter.-^ correct. Of the relatively ftr^ items to be learned 
(dealing with the nilativel;; more difficult questions), the viewing 
crosses learned si^ificantly T\ore~but there was no room for them 
to Zxir.rn, in frro*^'^ nuirorical terns, r.nn v itcins more. I'he question 
aii to whether the to:,t iuc:.ib reflect the difficulty level of the 
:';'.<.^\s c.-.itcni is a r.oo*: c Incisinuch a-^. the items do reflect the 

cliiiiculLv of the shw'i; content, the results indicate that the show 
was better keyed to first and second grade classes. 
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. In this section of the report the specific effects of viewing 
The Electric C ompany in school on third grade classes will be presented 
In detail. Tl:e following tables are relevant. 

— Tables 28a and 28b which present the pretest, gain, and adjusted 
gain scores of the viewing and non-viewing third grade classes 
in Fresno (28a) and Youngstown (28b). 
— Tables 29a and 29b which presf.nt the pretest and posttest teacher 
questionnaire scales and selected items for viewing and non-vie\^-- 
ing third grade classes in Fresno (29a) and Youngstown (29b). 
— Tables 30a and 30b which present the results of the observations 
of reading lessons in third grade viewing classes in Fresno (30a) 
an d Youngs t cwn ( 30b ) . 
— Tables 31a and 31b which present the pretest and posttest parent 
questionnaire scales and selected items for viewing and non-viewinj 
third grade classes in Fresno (31a) and Youngstown (31b). 
The Electric Battery 

ilie results to be presented here are based on ten pairs of 
clcf;srrcr3 in rro:.no end ten pairs in Youngstown. Overall, the sites 
provide quite similar results on the 123-item grand total. In abstract: 

Fres no Youngstown 
ViCrt'lng Non-via^ing Viewing Non-viewir 
^?*^tost 89.5 93.8 96.7 97.^ 

C^iin 14,8 ' 11,4 12.0 9.3 

Adjusted difference 2.4 2.4 

(viewing minur, ncn-vl(iwin[',) (SE 1,0) (SE 0.9) 

Tiie classes in Youngstown began at a slightly higher level than in 

Fresno, but the adjusted tnonn difference in gains between viciwing and 
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non- viewing classes was the same in both sites and it was, in both 
Irc.tances, statistically significant. 

In order to look more closely to discover in which goal areas the 
ir^pact was occurring, the following abstract is presented. 

Grade 3 



MATCHING WORDS 
Consonants 

Vow tils 

Cons on -'^nt Blends 

Coni^onant Digraphs 
Controilwd V^'./cls 
Larger Si^elling ?aLten--s 
Si-ht !':ords 
CHUNKING TOTAL 

Final e 

Double Consonants 

Open Syllables 

sc;o;nixg total 

Ljnear Blending 
Syntactic Units 

P 111* C c uT* i,i Oil 

Context 

Con 1 0 :•: t Vo c ib rj ry 
Context Scntenct^s 

R::ADI?:"t FOR ?1::\N1-'G TOTAL 

GiwvInD XOlnL 

Th'.- only tva irr;"- -* sccr. to have been affected by the show 

were comsonant digraphs and final "e''; but the gains positively favored 
the viewing classes in all but four of the 19 subtests in Fresno and 
all but two in Youngsf^wn. Tliu^s there was a general accretion in 
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favor of the viewing group and significant results occurred in all 
four total tests in Youngs town (Blending, Chunking, Scanning, and Read- 
ing for Meaning) and in three of the four in Fresno. No significant 
results were obtained in the attitude areas, the Metropolitan test:, 
or the individually administered test. 

* * * 

It is proper not only to look at the third grade classes as 
entities but also to look at the results separately in terms of the 
clc5:scs' tp.vz^l cor70r.cr.ts (children in the bottom quarter of reading 
achievement on national norms) and the non-target components (children 
abov? the bottom quarter). The following section presents the 
relevant analyses, 

Tr.r c^et and Non- Target Components : Third Grade 

The resuJts for third grade classes taken as entities revealed 
that The Electric Company had an impact. It also revealed that, with 
few exceptions, the impact was perforce small since third graders were 
£,'?n-- rally adepL- in the fpal areas and content being tested. In order 
to examine the question of whether it was the poorer reading third 
eradcrs, f.ie tar^iCt i;rou, , \A.o .<;howed the greater effect of the show 
or whether it was the. nor-ira:;ct rroup, the following tables will be 
rcfrrrt'd to: 

— Tjblet5 32a ond 32b wh. J\ present inc. prc-test, gain, and adjusted 
gain scores of the vic'.v'lng and non-viewing third grade target 
classes in Fresno (32a) and Youngstown (32b). 

~T<MoB 33a and 33b which present the pretest, gain, and adjusted 
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gain scores of the viewing and non- viewing third grade non- target 
classes in Fresno (33a) and Youngstown {33b). 
— Tables 34a and 34b which present the pretest and posttest 
parent questionnaire scales for viewing and non-viewing target 
and non-target third grade classes in Fresno (34a) and 
YoungJtown (34b) . 

An abslracL fro:.i uhese tables indicates that in terms of the 
Grand Total on the Elecuric Battery there were significant results 
(p < •10) for both target and non-target components in both sites 
(see Abstract II, above). In terms of the mean difference in 





n scores (viewLr.g uinu5 




coinponents) it can 


be seen that 


the effects were quite 


similar in 


the two sites : 






Fresno 


Youngs town 




Mean 


SE 


Mean SE 


Target 


3,5 


1.5 


2.6 1.6 


Non-- target 


1.6 


0.9 


2.0 0.7 



vie; t..ri;3l. i;roups i:.;^c^ slightly higher differential gains 
than the non- target groups but because the standard errors of the 
estimates were also higher, the confidence levels were about the same. 
In tha precoeding section when third ^rade classes were considered 
a vfiolc, an attc^rpt v^xs ir/»de to see. in what goal areas the impact 
Sdtii.xed greatest. Inis evidence .will again be presented but it will 
lu; broken do\ni so lli^.t the effects on tai'tjet and non-target components 
of classes can be seen separately. 
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(N.S. = not significant; * = significant at .10 level; ** at .05; *** at .01) 
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target classes at pretest had quite high achievement in relation to 
the test used to assess the goals of the show with an average of only 
15 questions wrong out of 123. Thus, the differential gains that 
occurred could only be in this narrow band. Basically the test 
developed to assess the impact of the show was not keyed to non-target 
third graders (those with a reading level in the top 75 percent of 
tlieir grade.) 

The individual test indicated significant impact for non- target 
children in Fresno only. None of the attitude or Metropolitan tests 
provided significant results.. 

* * * 

In general Tlie Electric Con^pany had a believaole (statistically 
significant) impact on third graders. Especially with the better 
reading children, this impact was necessarily limited by the fact 
that the test's content was not usually geared to their level. 
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The In-School Viwing Experiment; Fourth Grade 

The pattern of results presented first in Abstracts I and II and 
later, in nore Ct?tail, in the succeeding sections shows that The 
Electric Cotnpany seemed to ha\e a larger impact on the earlier grades 
where children had more to gain on the reading tests • The results 
for fourth grade children are in harmony with this pattern. In order 
to obtain a picture of the specific effects of viewing The Electric 
Con?any on fourth grade classes, the following tables should be 
examined: 

— Tablos 352 rn^l 35b which present preto^^t, gnin, and adjusted gain 
scores of vlc..'in^ and no i:- viewing fourth grade classes in Fresno 
(35a) and Your* town (35b), 
— Tables 3oa aud 36b which present the pretest and posttest teacher 
questionnaire scales and selected items for viewing and non-viewing 
fourth grade classes in Fresno (36a) and Youngstown (36b). 
— Tables 37a and 37b which present the results of observations of 
reading lcs:^cr. : in fourl::; grac^' viv./ing cla3se.s in Fresno (37a) 
and Yo*.::\c:'^ t^'..'n (37b). 
— Tables 38a and 38b which present the pretest and posttest parent 
qucs tio.-.nc.ire ocalcs and selccL.-'J. itr>: s f^r vi^rwing and non-viewing 
fourlh grncle clc.sses in Fresno (3'J.i) and Youngv.lown (38b), 
The effects in f'^t'.rth ^rade are n-.-tr^inal but sirnificant. At 
pretest the Frc:.-*no clwy:,jt. iuiv! only aoor-t 20 quostior.^; on the average 
in which to inprove and the Ycunnsrovn chipses hnd fewer than 15, The 
adjusted mean difference in r.*:^n (viewing rnlnuj; non- viewing) was 1.1 
in rro.sno and 1*2 in Youn{^,5;lown, r.oth these re?>ultr» were significant 
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but clearly of no great consequence. Three subtests provided significant 
effects in both sites — larger spelling patterns, final e, and 
punctuation. 

Target and Non-Target Components ; Fourth Grade 

The target and non- target components of the fourth grade classes 
can be exairiir.ed by referring to the following tables: 

— Trebles 39:^ unc! 39b whic'.. present protc^r, a^'-'^r^j adjusted gain 
scores for vievring and ncn-vicwing fourth grade target classes in 
Fresno (39a) and Youn^.t^tovn (39b). 

— Ivbles 40a a.icl 4ib vrhich pieoent pretest, gain, and adjusted gain 
scores for vicr'.nc; and rcr:-vi.e.;ing fourth f^rade non-target classes 
in Fr:.:no (40a) and Youn^ftcvn (40b). 

— Tables Ala and Alb which present pretest and posttest parent 

questionnaire scale scores for viewing and non-viewing fourth grade 
target ar.d non-target classes in Fresno (Ala) and Youngstown (Alb). 
From Ads tract II it was seen that significant effects were obtained 
with t:^.e non-tarr.et rorpcnents of the fourth grade classes in both sites 
and the. targit cor^oncbnwS in Fresno but not. Youngstovm. Tne Fresno 
Lorget ^roup who vic'cd ga:;:'^d gnif icantly r.:ore than the non-vic/ing 
gi'oap in the. areas oi va^'el co:;x>inations , consonant digrap'is , larger 
spelling patterns, final e, and punctuation. In Younf.stown , only the 
j.'u:'.ctt.aLioa iubtici,': vas significant. */:.e F-esno target grouj> alf;o 
ryiin.'»d f. j p;*:'! cantly r.ore t'-im the non-vl cverfi on the Metropolitan test. 

Ihe non-target groups SL:e::.cG to benefit most from the areas of 
larger spelling patterns, double consonants, and punctuation. Note 
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again ha;ever that the non-target groups scored, on the average, over 
116 correct out of 123 items at pretest. 'Ihus, the significant gains 
were necessarily marginal in terms of the size of the ^atns. In 
Fresno the non-target components of the viewing classes gained 3.9 
questions on the average compared to 2.6 for their non-viewing 
comparisons. In Your.gstovn the respective gains wore 3.6 and 2.0. 
Hie effects can be seen n.aJL.ily in a icj ite:.^. A large proportion 
of the iter;S have an average correct response rate at pretest of 
more than 95 percent. If the tests reflect the level of difficulty 
of the show, then the fourth grade results indicate that the use of 
television in t\'.c class roo:r. can n-.a^e a ci:fcrc-\ce ut the difference 
is small if the program is pitched below the level of the group. 
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Results of Teacher Questionnaires. Pareat Q uestionnaires, and 
Observations of Classes 

Discussion of data from teacher questionnaires, parent 
questionnaires, and observations of classes are presented here 
rather than in the preceding section that reported test results 
so that the flow of the major analyses would not be interrupted. 
These c'atr. arc necessary for a fuller understanding of the 
results presented. They provide descriptive information that may 
be used to der.or.s tratc cor.?arability of classes as well as 
affects that. I'.'.c Clo-"iric Cor.?:'.:.-/ had on teacher and parent 
behavior. 



a. The Classes 

This section presents a description of the teachers and 
classes in Fresno and Youngstown. The following tables pro- 
vide the basis for this discussion: 

Tpblcs 16a-b and 17a-b for data on first grade classes, 
•iables 22a-b and ?-3--b for data on second grade classes 
Tables 29a-b and 30a-b for data on third grade classes, 
•iablos 3Ca-b a:.d 37a-b for data on fourth grade classer 
It was seen that the nuirier of children pre- and post- 
Lc.:u J rer cl.rcs varied betr.ccon the sites. In Youngsto^«i, 
vhove attrition Tas less and distances between schools 
smalJer (allowing more frequent call baclcs to get the. post- 
tesling accoir.plished more efficiently), the average number 
of children tested in earh class was about 90 percent of 
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those enrolled. In Fresno, about 80 percent of those 
enrolled were tested. Whereas the proportion of children 
tested in the two sites was different, the wean age of 
children at pretest hardly varied between the two sites. 

The teachers in the two sites had a similar number of 
years of education (about 17). They also had approxinately 
the sa-.c nurccr of y^ar3 of teaching experience (averaging 
12 yCvTs), except in first grade where Youngstown teachers 
had about six luore years experience than Fresno teachers. 

rne attitudes of teachers to educational television, 
phor.ic? in vc'dinZy linguistics in reading, Soi^^r-e Street , 
and ^he reading perfonr»ance of their pupils were assessed • 
by the teacher questionnaire at both protest and posttest. 
No striking differences in teacher attitudes were observed 
between sites or between teachers of viewing classrooms and 
non-vie.s'ing classrooms. In general, the teachers seemed to 
have a pc-^.itive attitude to the oti^er CTW show, Sesa-n e Streo ^ 
to the use of a phonics approach to teaching reading, and 
to the poorer readers in their classes. 

In both sites the majority of teachers said they used 
a phonics approach as the major teaching method. Ihis and 
sii.ilicir information from ti>e teacher quL.stionnairtjs should 
be low>!u-d at in conjunction with Che observations conducted 
in the viewing classrooms, 'ihere it was found that teachers 
spent on the average very little of the time observed 
specifically teaching phonics. In contrast, the sight read- 
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ing of /hole words, not specifically related to a phonic 
breakdown, comprised somewhat more time in Fresno and 
somewhat less time in Youngs town. In general, phonics and 
whole word approaches seem to have been frequently used 
by teachers in both sites and the overall impression is 
that electicism was paramount. 

Perhars t'-.ci "ost dramatic difference between the 
classes on the one hand and the show on the other is that 
even in first grade the classes in both sites spent about 
a third of their tire in reading phrases 2nd str.tences. 
T!ie shcv7 spent only about ten percent of its time in these 
activities . 

Tb.e biggest differences between the sites' reading 
instruction programs seem to be in their choice of text books 
and the use of "child-centered" instruction techniques, nie 
majority of teachers in the first through third grades in 
Youn-.tovrn i-.sed the Scott Forcsman Basic Readers and in 
fourth grade almost all used The G: nn Basic Readers. In 
Fresno, different reading texts were in use though the 
Harper and Row series was mosL con:..on. From Lnc obscrvatic:t.3 
it ..ppenred that in Younj-.stown in tlie earlier grades more 
Lii:.e was cp:'nt: cn "d : ld"Ocnterc<' i-,tructlon" — that is, 
u!>erc the tor.ch"r wan not actively teaching but the child 
was pursuing a reading actLvity relatively ind-. ;>ondently . 
'lliis did not occur in the third and fourth grades. 
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Of keen interest to this evaluation is how The Electric 
Company was included in the class timetable. Was the time 
taken by the show subtracted from other reading activities 
or did it come from other sxibject areas? Some teachers do 
not find it easy to supply a clear answer to this question 
because a strict timetable is not adhered to in their class- 
rco.T3 and because reading, in the early grades especially, 
is a pervasive subject that crops up in virtually every 
lesson including mathematics, social studies, science, and 
even music and art. If a central theme or project approach 
is v^ed in a class, nar;y subjects tend to be fused or inte- 
grated and again it is difficult to estimate with accuracy 
hm r.uch time is typically spent on an activity such as 
reading. 

Tlie question nonetheless has to be asked because the 
answer can have a considerable impact on the interpretation 
of the o.reriTr.eutal results. If The r: l cc:.rlc Co?:ocinv had 
been timetabled in classrooms so that it added to the amounc 
of reading tine, then positive results, while still being 
influenced by the sho;^, would raise the alternative hypothesis 
tbnt ^vi additionnl half hour of reading instruction of any 
type per day might have had a similar impact. Further one 
would nr.lc wheth v tl\e time so talien from sone other area 
(say social studies) had had a deleterious effect on the 
classes* performance there. If, on the other hand. The 
Elertric Comnanv had simply been substituted for other forms 
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of reading instruction, then the question of negative impact 
on other subjects would lose prcr.inence. The alternative 
hypothesis that it was increased time rather than the show 
Itself would be unreasonable, and the ?how would have to be 
at least as beneficial as the reading instruction it 
displaced even for no differences to be noted between 
experimental and control classes. 

It was decided not to attempt to experimentally manipu- 
late or control the. variable of ti!^^e spent on reading for 
several reasons. First, there is always a problem in large 
scale field research in obtaining the necessary cooperation 
of other institutions. In this case, school boards, adminis- 
trators, and teachers wore, already being asked to permit or 
to cake sizable changes in school activities, including extra 
hours of clasi5roo:r. testing, classroom viewing of an unknown 
television chow over a six-month period, the irjtrusion of an 
observer, the filling; out of questionnaires, and the collec- 
tion of paroinL questionnaires. Second, even if permission 
hp.^] Vc'v, c-^-^ited for a f5.it to bo issued indicating how much 
tir.ii wr/: to Lc^ c^pcnt on reading ir. each cl<M^sroon, tV.ere is 
consifierc-ibJe doubt about hw well that would have been 
obscivcJ. rroiesslonai Ueadiers, k:iv>*.;ir.g best what l:ie neoJ 
of r.ioLr rlri.-;^:es arc, will often "sncnk" j :..e tine from one 
£;ubjv>cc ai\-a to bolster perforn;ancc in another with greater 
utjo.]. l\ v«ir. c'r.o rt'ft»re, to let tht- teachers 
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and administrators use their ovn judgments on time allocation 
and for us to assess the amount of time spent • 

At pretest and again at post test teachers were asked how 
much time they spent teaching reading. It was expected that 
at pretest the viewing and non- viewing classrooms would be 
similar on the average due to randomization and that any 
divergence at the posttest would represent the impact of the 
show* 

It was apparent from a review of the teacher questionnaire 
responses that there was a great deal of variability within 
sites. For example, an abstract of the responses of viewing 
(V) and non-viewing (NV) teachers in first grade classes 
indicates : 

Fresno Youngs town 

Pre Post Pre Post 

V NV V NV V NV V NV 
Tir.e for Reading Mean 545 590 524 586 541 550 583 513 

(rdnutes per week) SD 211 141 181 165 135 117 139 122 

Because of this large variability (as indicated by the standard 
deviations), quite large differences in the means would be 
needed to indicare significance. In general, however, signifi- 
cant differences were not noted. In later grades, teachers 
reported spending less time on reading instruction than in 
first grade. 

As well as these results which address indirectly the 
question of where time for viewing Tlie Electric Comnany came 
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frotn, all experimental teachers were asked the question 
directly • In first grade in Fresno, six of the 11 teachers 
said they used the normal time allotted to reading, four 
of the others took the time from such other subjects as 
Social Studies, Science, Music, and Art, and one used rest 
and recreation time. In Youngs towr, three out of the ten 
teachers used the regular reading instruction time, six 
used time from other subjects, and one used rest and 
recreation time. Thus, of the 21 teachers of first grade 
vie^^ing classes, 12 used time normally devoted to areas 
other thc.ri reading. In second grade, about two-thirds of 
the teachers said they took the time out of regular reading 
instructions; in third and fourth grades about half did. 

In order to find out whether it was the extra time that 
caused the significant effect, the performance of first 
grade classes who took the time from other subjects was 
cor.prtred \ ith the performance of the first grade classes 
who retained their normal time allocation for reading 
(substituting The Electric Company for other reading 
instruction). Tnc total adjusted scores of the viewing 
cloo:5es which took extra time for reading as a result of 
the prer.encG of Tlie Ele ctrj c Company were compared with the 
scores of their paired non-viewing classes scparalely in 
each site. Similarly, this comparison was also carried out 
for those classes who took time out of the regular reading 
tii.ic: to vicn%'.the shw* The results were: 
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Fresno Younf^stown 
Adjur.icd 

Pretest Post test Gain Variable Pretest Posttest Cain Vw! 





N*5 pairs 




s ub i ects 


N=7 


pairs 




Viewing 


15.8 


76.1 


60.4 


15.9 


81.5 


65.5 




Nour Viewing 


15.9 


/I. O 


56.0 


15.1 


67.1 


52.0 




Viewing minus 
Non-Vlewlng 


-0.1 


4.3 


4.4 4.5 


0.9 


14.4 


13.5 


9 


ES of Estimate 


0.9 


4.3 


3.9 4.8 


0.7 


4.3 


3.7 










Ti:v^ frc". :t..i± 




N=3 


pa:, r/ 




Viewing 


14.7 


72.0 


57.4 


15.9 


78.6 


62.7 




Non-Vle.^ing 


16.3 


72.7 


54.4 


15.1 


63.8 


48.7 




Viewing minus 
N'on- Viewing 


-1.7 


1.3 


3.0 9.3 


0.8 


14.8 


14.0 


31 


SB of Estimate 


0.6 


3.3 


2.8 3.4 


1.5 


6.7 


5.2 


1 



The results Indicate that both in Fresno and in Youngs town 
first grade classes which took time out of their regular read- 
ing prozi'eiT.3 to vie.v* V ^o E] 9- t rie Co::nrry fained signif icantlv 



fror: the or.crience. IChen tlr.e was t?ken from other subjects 
(t:v.;]tiby incircasing Iho total ar.p-jnt cf tirct snent on teachinr. 
reading';) the ir^pact of Tne Electric Cor,)nn%' was significant 
onlv in Voi!nf,5tov7n. Nothing In these analyses indicates that 
ad<Utioji<-i][ time in reading was responsible for the significant 
rer;u3:-^. obtained ::ith first yj.ide vicvinn classes. Ilie same 
analyses could not be performed in the other grades because 
the great r.aJorlty ol teachers in anv one .site and in anv one 
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indicate 


that both 


in Fresno and in Youngs tov;r. 





first grade classes which took tiine out of their regular read- 
ing proarar.*-3 to vlcis- T! ^e K.l ^ -lric CGi.-pn-'y ^ctxned signi f icantlv 
froir. the experience. U'hen tine was ti?.ken from other subjects 
(iheiiiby 1 nci." casing the total ar.o-jnt of tir 2 vSnent on teaching 
readir:^';) the ir^pact ol rne Electric Corpanv was significant 
onlv In Yor.nr.s tov7n. Nothing in these nnalvses indicates that 
additic/iial time in reading was responsible for the significant 
rc'.su3L<-. obtained with first ^'.r.ide viewing cia5>ses. Tne same 
niKilysci; could not be performed in the other grades because 
the great rujority oi teacher:; in anv one Kite and in anv one 
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grade tended to adopt one or the other pattern — that is, 
almost all took time from reading or almost all did not; 
so there was no opportunity for a useful comparison. 

One problem still remains though it is a less press- 
ing one* The problem is, what is the effect on other 
subjects when time is taken from them for viewing The 
Electric Company ? The potential negative side-effect of 
taking time from other subject areas is currently under 
investigation in the ETS follow-up on this in-school view- 
ins study. 

Teadiers who used Ti.q Electric Cor: any in their classes 
rated the program^s usefulness in teaching various skills on 
a five point scale. In both sites the ratings were generally 
positive but in Youngs town the ratings seemed somewhat more 
positive than in Fresno in first and second grades while the 
reverse was true in third and fourth grades. In all grades 
one of the hi^^hesL ratings was given to the shovr's usefulness 
in reviewing phonics. Also highly rated were the show's 
effectiveness in teaching phonics and letter groups. The 
shov. was rated by the vast majority of teachers as having 
appropriate attention-holding cliaracteris tics , vocabulary 
3evel, pace» nvsthods of presentation, and subject matter. 

On tliG average, t:ie Lc.chers were not on the negative 
side on the 18 ratings of l lie Electric Co:::pany . Tlie poorest 
ratings were In the shw's ability to teach comprehension. 
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morphemes, and syntax. In Fresno, but not in Youngstown, 
first and second grade teachers tended to be neutral or 
. somewhat negative toward the show^s vocabulary level, pace, 
raethod of presentation, and subject matter, 
b. The Parents 

It is, of course, important to know something of the 
home and parental background of the children in the study 
in order to be able to describe the sample, to con^are the 
composition of viewing and non-viewing classes to ensure 
comparability on inportcjit factors, and to look for possible 
mediating factors in the learning of the children. 

Parent questionnaires were distributed and collected by 
classroom teachers at pretest and again at posttest. The 
rate of response was reasonably high though it dropped off 
somewhat at posttest, possibly in reaction to the fact that 
questions were repeated. The rates of return were: 
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Tne Dosttest parent questionnaire was identical to the 
pretest questionnaire for two major reasons. First and more 
obviously it was important to see if differences occurred 
in the responses and attitudes of parents of viewing children 
in contrast to control children. As well, since some parents 
who did not respond at pretest might do so at posstest, items 
assessing such factors as level of parents' education were 
repeated. The response rates of parents returning one or 
both questionnaires is given above and indicates responses 
from all but about ten percent of the parents. In this wav, 
a clearer description of the parents of the saraoled children 
was obtained. 

Tne scale scores derived from the parent questionnaire 
reflect the different populations the sites represent. 
Child affluence, parental affluence, and years of education 
all were somewhat higher in Youngs town than Fresno. Again 
the decision to keep .he analyses separate for the two sites 
seems to be validated. 

The important questions are whether viewing classes and 
non-vicv;lng classes were comparable within each site at 
prete<;t and vheUher thev continued to be at posttest. In 
penera] , the parent questionnaire data reflect slight 
diifcrcnccs ar, pretext, but the.se were not regarded as 
important, especially when it is recalled that response 
rates were not identical. A.*; a whole the parents were not 
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as well educated as the national average. The mean percentage 
of high school graduates in the sample was less than 40 percent, 
whereas for the age group represented a national figure would be 
close to 70 percent. This was to be expected in view of our 
deliberate policy of looking for schools where reading problems 
and The Electric Company target groups were to be found. In 
similar fashion, it is interesting to note that the school 
expectation scale indicates that the parents see their children 
as doing only as well as or poorer than most other children 
(a L.aaa of 7.0 would indicate an expectation of average 
perf ornance) . 

Other pieces of information from the parent questionnaire 
include the prevalence of color televisions in the homes. 
Tne respondents indicated about 50 percent have color television 
in co:;lrrvSt zo a national average only about five percentage 
points hif^her. (Note, hc^^ever, that all classes in Fresno and 
half the classes in Youngs town view'ed The Elect ric Co-panv 
on black c.id se'Jo in sclkcol.) 

In general, chanpes from pretest to posttest in the 
ror.pon'5GS of parents of viewing children were similar to the 
chanr,cs on the respoiu^es of parents of non-viewing children. 
/.:; cxctipt'wn to thic vn:> the response in first grade to 
t]:c qucr.Mon, 'Mow well docs your child read? At pretest Ihc 
respoa^^es of the V^o groups of parents were similar. At 
pv'>ntif'r.t , hcr.'cvor, the parents of the viewing classes were 
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as well educated as the national average. Ihe mean percentage 
of high school graduates in the sample was less than AO percent, 
whereas for the age group represented a national figure would be 
close to 70 percent. This was to be expected in view of our 
deliberate policy of looking for schools where reading problems 
and The Electric Company target groups were to be found. In 
similar fashion, it is interesting to note that the school 
expectation scale indicates that the parents see their children 
as doing only as well as or poorer than most other children 
(a i.^aa of 7.0 would ir.Jicite ar. expectation of average 
perf oimance) . 

Other pieces of inforr.aticn from the parent questionnaire 
include the prevalence of color televisions in the hones. 
Tne respondents indicated about 50 percent have color television 
in co::'>.rr.st ro a national average only about five percentage 
points higher. (Note, hw^ever, that all classes in Fresno and 
half the classes in Youngs town vie»-ed The Elecuric Co-pany 
on black c-.:d -whi'-e Sils in scliool.) 

In general, chanpes from pretest to posttest in the 
ror.ponses of parents of vle./ing children v/ere similar to the 
chanr,cs on the ref.poiiues of parents of ion-viewing children. 
A:-, c-.-.c opt! o;-. to this: v.-a.: the response in firtt grade to 
tire qucr.rion, "liov well does your child read? At protest Lhc 
responses of the f^o groups of parents were similar. At 
p.-.lte.'-t, hcr,cvor, the paints of the viewing classes were 
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significantly raore likely to say they thought their children 
were reading about the same or better than most children* In 
abstract: 

Average Percent.-^ge Responding that their rirst Grade Children 
Read as Well as or Better Than Most Children 

Fresno Younp^stown 

Pre 

Vieu'ing 
Non- viewing 

Inioruiatioii irom and about the paients of taxget and noii- 
tarf:et children r.re also reported in the Tables In Volume 2. 
Both in Fresno and Ycungstcwn the parents of the non-target 
children are seen to be more affluent, had more education, 
fewer children, read more to their children, and had higher 
school e>rpectations for their children than che parents of 
the target children. Tliis is hardly a surprise since it is 
quite cor.sonar.c v:Jlh previous rc<?oarch on socio-ccononic 
status (variously defined) and achieveir^ent in school. 
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Ala~b for fourth gr^ide. 
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^ 7, Analyses of Various Population Groups In the In-School Viewing 

Experiment 

To this point the data from the In-school viewing experiment 
have been examined separa^ ly by grade and by site using the paired 
classrooms as the unit of analysis. The data have also been 
examined separately by target children as one component of the 
classes and by non- target: children as another component. 

In this section, the data from the in-school viewing experiment 
will be reexamined, this time to determine whether The Electric 
Co-pany worked for boys, girls, and for other populations — Spanish 
background, black, and vhite. It should be ncced that the initial 
site selection had been made with the realization that in Fresno 
there would be a substanciai proportion of children with a Spanish 
(^J background and in Youngs town there would be a substantial proportion 

of black children. This, coupled with" the random allocation of 
members of paired classes to treatment or control conditions, allows 
ar.alysco to ha condu<..ted to c^ter.ui.e whether the show is cffcciJ^.' 
for white, blnvk, and Spanish-backfa-ound children when comared with 
their counterparts in non-viewing classes. Siiailarly, boys (or 
girlb) who arc in classc. vhld: vi w vortu^; boys (or f/.i"^-^) ^'^"^ 
in clas.so-. vhich do not vii..- ca : be cci.porc:!. Direct con^.parison-^ 
between dlfferrnt f:roupr, of viwinjt children (for example, boys 
versui, r.irls or blac-s. vei^jui^ wl.lte) should be avoid.-d hoccni<.c sil- 
ls confounded with population (in that Spanish background is 
associated with Fresno and black is associated with Youngslown) and 
bocause tiie original sa.':.pllnr> and pairing were carried out without 
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special regard for sex or background of the children. While it is 
inappropriate to inake inter-population comparisons, it is not 
inappropriate to make intra-population comparisons. That is, the 
question is whether a particular group who vie^rs gains from that 
experience in comparison with a similar group who does not view, 
a. Sex Groups 

Each class in the in-school viewing study contained both 
boys and girls* A mean total score for boys and for girls 
was computed separately for each viewing class and for each 
non--viewing paired class. This was done lor each grade in each 
site. Abstract III provides the main details. Note that all 
classes had both boys and girls so no pairs of classes were 
dropped in this analysis. 

At protest, girls outperfom^ed boys slightly but 
cons is to:: I ly in each grade in both sites, Tliis is in line v:it.h 
most previous studies of sex differences in reading achiever.ent 
In the early school grades* In first grade in both sites the 
i^alxis of tho, \lc.:±Vi^ buys and girls were siguificanlly larger 
than th^'>^5G of their non--vicvlng counterparts. 

in Cicrr^n-:! grada in botii sites the hoys who vicvt?d gained 
signiiicantly more on the battery thnn those who did not vicv: • 
lor t,ir3:: uJi^^ w-. iv Ic.-jc; clt.ar-cat. Tn Yoii!:[;ytovn, 

but n.^t :n rrc\-.riO, the of the viivlni; were 

£;:i):nificrnt:ly £;roator than those of the non-vic,i?ing girls. 
Tncju' .:vo p-.rt 1 r^jlarly i ntoros li nf; v/hcn ;u-en ajviir^.r 

l!ie Lacl.:;vuunci of t!ic rc^u.lla of the* in.act clas:>es (sec 
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Girls 
Fresno 
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Pretest Pcsttcst Cain Variable 


Boys 
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Abstract I). Then it was noted that in second grade, Fresno 
viewing classes gained more than Youngstown viewing classes 
In relation to their respective controls. It Is clear from 
Abstract III that the boys in Fresno were primarily respon- 
sible for that result. Note that Fresno second grade boys 
started son:cvhat lower pretest, than Youngstown boys and 
the non-v.lcv.-lr.g Ficono boys dropped further behind the non- 
vie.-ing Your.g^tovn boys. However, the viewing Fresno boys 
gained substantially and their differential gains over the 
nou-viewing boys were more than four times greater than the 
Ktrnd^rd error of that diifcrer.cc. It is also interesting 
to note in passing that in both sit:es in second grade the 
viewing boys ourperfomed the non-viei.-ing girls at posttest. 

The third grade results generally parallel those of 
second grade. Again the results were significant for boys 
in both sites, with viewing boys clearly outgaining non- 
\ic\'ing bcyr.. .-O^in, too, the v:c-.::ng girls outgained non- 
viewing girls but the difference in gains was significant 
only in Youngstown. 

In fourth grade a reversnl of the pattern noted in second 
and third gnu'o. occurs. In every in.^*tr.pce vie;/ers outgaincd 
their comparison non-viewing group but here the difference in 
Z'^jvs wa£; 1 ,r.nt for f^lvl^ in both sites; for boys, 

hou'ever, a significant difference in gains occured in Youngs- 
town but not Fresno. As was seen in previous examinations 
of the data from the fourth grade classes (especially the non- 
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target com.ionents) , the size of the gains was limited bv 
0 high pretest scores. Thus, for example, girls in Youngstown 

at pretest obtained, on the average, all but about 12 questions 
correct. 

Overall, the results for both sitea, while differing 
^ slightly at some grade levels, provide a degree of coiu;i<=tency . 

The first grade results indicated that boys and girls both 
benefited from viewing The Electric Company . The second and 
third grade results tended to favor the bovs and the fourth 
grade result^ tended to favor the girls. In all grades bovs' 
pretest scores were somewhat lower than the girls' — chat is, 
boys were in somewhat higher pronortions in target than non- 
target groups. It was seen earlier that target children seei^ed 
somewhat better helped by the show' in second and third grades 
and non- target children in fourth grade (probablv due to a few 
rather difficult iLc;ns and content pieces on the show), and 
the results on sex differences at each grade level seem 
consonant with these earlier findings, 
b . R ace and Language Gioups 

H-:e populatioa<; being studied in the Wo sites differed 
and there were site differences in results. Tnerefore, it is 
not reasonable to make comparisons among the three groups beins 
studied here— Spanish background, black, and white. Comnaripnn^- 
to be made will be within each group, looking at vic.-ers versus 
non- vi aiders . 

Ihe analyser, in tl: Is snction were conducted using the 
saii?c. techniquoj ar; described in previous sections, lluit is. 
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for each class in Fresno the scores of the Spanish-background 
children and the white children were processed as separate 
components. For each class in Youngs town each class score was 
similarly broken into two components, one for black children 
and one for white children. Because the population breakdown 
was about (Spanish-white-other) in Fresno and 50-^50 

(black-white) Youii^,;. town, the decision to drop pairs of 
clcssroonu? from the analyses v/here a cor.ponent was not 
represented led to only a few pairs being dropped. 
ST>;?r»i<^^-b??rV<»rotind_^nd white com ponents: Fresno 

Tile cl^^iz.itic:-. cf Si/ar.l^h has to be nude in tern:s of t::o 
procedures adopted in the field work for this evaluation. As 
each ciafis was tested children who spoke only Spanish and who, 
therefore, could not take the test in English were dropped 
from Lhc sar-ple. In fact only some AO children were eliminated 
on these grouiids . Teachers classified the children in their 
c2c::^.sc:'5 to \\. -ther u.u/ had a Sp^ni^'u l-nckground and whet:>"r 
the children tesced .:ould speak Spanish as well as English, 
About 80 porcGnl of tne Spanish-background children could 
s-^ra!: f):^:-^.i.^ t-nc' tn^/^^'cb , so the Spani?h*barkr;round component 
of t\\L ;*:y -nj c'^--;v'. !:*:'Cvi]y bJlincu'iK 

Th.c rc'«t:H-s of the Spanish background and white component 
an:^l>.'' in ai- p; ;.'i;c-ntcd in /vbbtr^icl IV. It cm be 

s-en that Spanish-background children benefited signif ixantly 
froH'. viu:ir:j; llie ^^.i^lJl' comparison to their non- 
vle:iiv.; coun(.on;'!rlf; in first, second, and third grades. The 
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first and second grade results indicate a relatively 
substantial gain by the viewing children and the third grade 
results alsr indicate a rather large benefit for viewers in 
comparison to overall third grade results presented in 
Abstract I. In fourth grade, the results were not 
sig^iificant though they continued to favor the viewing children. 

The results seem to indicate quite clearly that viewing 
The Electric Company in school had beneficial results for 
Spanish-background bilingual and English-speaking children in 
thu first three grav-es. 

The results for the white children in Fresno, also presented 
in Abstract IV, indicate that The Electric Cor.pany significantly 
benefited viewers in first, second, and fourth grades. The 
greatest benefit, in terns of actual raw score differential 
gain o-er non-viewers, occured in first and second grades. Tl-.o 
third grade results are interesting in that this is one of the 
quite rare occasions for the in-school viewing experiment when 
nor.-vf overs £:ained :rore than the vic-'ers. The difference favor- 
ing the non-viewers is quite small (adjusted difference is 1.7 
itu:ji>) and the standard error of this difference is much larger 
(2.5). Thus, in Fresno, for the v/hite as well as the Spanish- 
bc*5c);rrou-Kl children, tlie rosulti> incMrntiinr the utility of T' c 
VAx'Ctri '\ Company iro especially clear in the first two grades. 
In the later grades the differential is smaller but still 
slrnt f icantly favors the Spanish-backj'^round viewers in third 
grad^' and the while vit-v/crs in fourfli grade. 
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Black and white components: Youngs town 

The basic procedure adopted here was the same as was 
adopted in the Spanish background-white study in Fresno. 
More pairs of classrooms were lost in Youngstown, however, 
because there were some all-white or all-black classes. 
The results of the breakdown of the classes into black 
con.ponents and white components are presented in Abstract IV. 

The black children gained significantly from viewing 
The Electric Company in all four grades, though the second 
grade significance level was marginal (p < .10). Ihe first 
grade results were particularly strong and reflect the 
results obtained overall for first grade classes in Youngstown. 
By the sare token, the relatively weak second grade results 
also reflect the overall second grade results for Youngstown. 
The major point is that, as a group, black children benefited 
from viewing the show and the impact was not confined to any 
one £rade. 

The white children's total scores treated as components 
of the Youngstown class scores also showed differential gains 
from viewing The Electric Con-.pany , the effect being significant 
in first and second grades and marginally so in fourth grade 
(p < .10). Tais pattern of results is virtually the same as 
v:as seen with vh^tc children in Fresno. In ten:us of size of 
effect, the major effects seem to be occuring in first and 
second grades . 
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TiiUSy overall, white children and black children in 
Youngs town both seemed to benefit from the show in much the 
same way and to a similar degree as Spanish-background 
children and white children did in Fresno. The Electric 
Company seemed to have positive benefits for in-school view- 
ing children, especially those in first and second grades. 
Tnis cited scc.,,*wuto occur for all popuiacioa groups whose 
scores were subject to analysis. 
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Analysis of Color and Black and .White Television Reception 

A question of Importance to those Interested In communications 
research concerns the effect of the type of television reception 
(color versus black and white) on the learning of the vlet/er. There 
was no opportunity to study this question rigorously with respect to 
The Electric Conipany In the<at-hoiae viewing experiments because the 
type of set used to receive Tiie Electric Cor/pany was inextricably 
confounded with many factors including the social and economic status 
of the family. For the in-school viewing study, however, an experiment 
to assess the differential impact of vxewing the show In color versus 
black end white v/as possible in Ycungstovm but not Fresno. (In 
Fresno, the show was telecast In black and white only on county-v;ide , 
closed-circuit television,) 

In Youngstown, there were ten experimental classes in each of 
the first, third, and fourth grades and 20 experimental classes in 
second grade. It was decided to assign to a random half of the 
experimental classes in each grade a color television receiver, the 
others receiving a black and white set. It was thus possible to com- 
pare the effects of the show when viewed In color with the effects 
when viewed in black and white. 

Abstract V provides the pertinent data on this experiment. Tlie 
classes that viewed the show in color are compared with their non- 
vie^^ing paired classe^. Sir.ilarly the classes that viwed on black 
and white sets are compared with their paired control classes. It 
is thus possible to see if the effects of viewing were stronger with 
the color or the black and white reception. 



t4 



1 



ERIC 



25 



00 ^ 
• • 

CM CM 



CO vo c*^ 



NO r-i 

\£> ir^ fH 



<r f-t CO 



CM 1^ "0 m 

CO vo 



rH VO in •H 
« « « • 

so m O •H 



CO 



iH in NO CM 



m o CM <r 
o m fH 



iH cTi 



00 in CO <r 

O f-l 



vO iH vo 



in <r rH O 



5? 

ai 
I 

n 
o 



CD 
U 



u 

25 



CO CM 
CM iH 



C30 CM m iH 
• • « • 

m -d- iH 
CM CM 



rH ON CM VO 
• • • • 

CM <f CO 
o o\ 



o 

• • • • 

NO o m <r 



- o 



u 



O NO 
• t 
CM iH 



CO 00 tn CO 
• • • • 

ON H H 



iH ^ NO ON O 



li 

25 



^ CO m CO 

o CJ> 



iH 00 <r o 
• • • • 

CO 00 CO 

00 









O 






w 










C3 




to 




a 




r: 




..J 












> 






{.0 


a 






f: 




t: 




•H 


> 








1 


t? 


o 


<i 




O 




•H 


o 


•H 




> 


2; 


> 





"4 

a 



I 

c 
o 

55 



CO 

t« I o 

(I) C 
> is > CO 



(0 

V4 

•H 

m 
li 

25 



- O 



(0 

V4 



a. 



m 
I] 



CM O 
CO CM 



o 00 00 
• • • • 

O ON iH iH 



rH NO m 



o m iH 

iH O 



CO CM 



ON NO CM CM 
CJN C7N 



CO ON 
« • 

CM O 



CO NO CM 

« • « • 

CO ON CO iH 



o <r ON 

• • « • 

f^. CO rH CM 

C O I 



O r-{ O ON 
• • • « 

ON m CO 



CO 

u 

•H 

m 

li 

25 



iH O 



o vo in CO 
• • • • 

m ^d" o iH 



00 1-H vo 
• • • • 

m CO CM iH 



00 »n CM m 
• • « • 

O 00 CM CM 
iH O 



V4 



(X 



m 

li 



m <r 
• • 

o o 



iH iH C7N 00 
• • t • 

NO <r »-i o 



m 00 CO <r 

• 4 • • 

<r <r o o 



in cnj iH 

• • • • 

00 O CM iH 

O iH I 



t>0 

r: 



•H 

I 

o 

0) *J 
> CO 

to o 10 

> I o 

Q) CJ C> 
•H O W 

> 55 > 



C2 
00 0) 

> 25 



00 

a 

> 
I 

c 

CO 

to c 



60 U3 

> o 

> CO 



CO 

(1) 
u 

0) 

a* 

o 

I 



134 

It should be noted that- the N*s were quite small so that the 
power of any statistical testing would not be great. Nonetheless, 
the results indicate a rather close similarity between viewing in 
color and viewing in black and white. In first, second, and fourth 
grades the effect was slightly in favor of those classes which viewed 
with black and white sets and in third grade it favored those that 
viewed in color, lae color scis, though i.^ure e:<pensive, do noc 
seem to enhance the learning of the classes who view with them. 

Tnis is not to say that judgment is here passed on the aescnetic, 
motivational, or emotional impact of color over black and white 
rt.cc;^::iG.i. r::e5e ;:c«e tCviC3 I'.iat rcr-:' nol* cirectly a'!crc5sed i:. 
this research. We do know that some teachers with black and v/hiue 
sets co.-pl.iined that there vcie tech:dcal difficulties (words on 
the show blending into the background material, for exaniple) thar 
they felt color reception would have overcorie. Some teachers, 
after seeing the shcv both on color and black and white sets, 
ar^:i.cci 'c:\cX color %:iic. t.otcs atl-riliori /.eciln^; and attention hol^ir*". 
However, the point is that in terns of learning in the Youngstown 
viewing cla3sroo:r3, color television did not seem to h?ive a 
Ptronrnr Jr^Kict v'^r.w b''ac!: and \'h5te televii-ion. 
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Analyses of Attendance Records 

In order to see if viewing The Electric Company had a positive 
effect on the attitudes of the viewers toTA^ards school, an unobtrusive, 
non-reactive measure — the classes* attendance records — was 
obtained. It was argued that if The Electric Company has a positive 
impact, children would regard schoo? in a more positive fashion and 
would be lc:>s liktiy to vanc wO slay ho*..^, Tiie problem with this 
measure, as indeed with most such measures, is that there is a 
considerable jump from the assessment (in this case th" attendance 
records) to the actual construct being met^^ured (attitude to school), 
KCoCVcr, uvc'.;, :.l::icu^c r..-.ure has its cvn iiuherent problor.is and 
already incorporated into the Electric Batte.y were two different 
paper r.nc" pencil attitude tests. Because of the ultimate 
importance of the attitude area to later reading behavior, and 
because multiple ^issessments of variables is desirable when no 
single a£;SL^s::ant hc'iS great construct validity, the attendance 

As in the otiier analvses , data for each grade and each site 
v^ere kept separate. The aiiondancc data were then analyzed bv 
calcu"^ ct: r;; the rv?rir^,o ,\^r.t-ntee rates for vi'?^;ii"ig classes and for 
non-vlc:i n:: cL*. ..or. sc'p.;raLcly for the »..:>ntlis of September and 
October (per-pro?ran base rate) and November through May (during 
tiu* t(.-i4 Cv l.ic T,.iv.::a and :> l;...<l.:rJ cu-vintions are 

here presented. 
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Average Daily Absentee Rates of Viewing and Non-Viewing 
Classes in Frosno and Youngs town 





September and October 


November through May 




Fresno Youngs town 
M SD M SD 


Fresno Youngs town 
M SD M SD 


Grade 1: 
Viewing 
Non- viewing 


6.6% 2.4% 5.7% 1.0% 
7.1 2.6 7.2 3.3 


8.4% 2.5% 8.8% 2.6% 
8.9 2.4 9.9 3.0 


Gr:^: 2: 

Vie;'ir3 
Non- Viewing 


A. 9 1.9 5*3 2.1 
5.3 2.2 5.1 1.8 


7.8 1.8 7.9 1-9 
7.4 1.6 7.9 1.6 


Grade 3: 
Viewing 
I\on-Viewin[, 


5.0 1.8 5.5 0.9 
3.4 0.9 4.7 1.9 


7.6 1.4 8.6 1.0 
6.3 1.5' 7.2 1.1 


Grac''3 A: 

Viewing 
Kon- Viewing 


4-9 1-4 4.7 1.0 
4.6 L.8 5a 1.7 


6.9 2.2 7.2 1.3 
6.6 2.6 7. 7 2.2 



It can be seen t'lar ?b6v nivc: rates were quite low (less th<.;: 



10 percert) in e-jch f:ite at each ^rade both eqrly in the academic 
year (pre-^program) and later (during the program). There does not 
seen t:o be .-.u/ sysLnnntic c.xf f ,:rt. nee bclwooa the absentee rates of 
the vicvin:^ and non-viovv Jr-B clar^sc^n before die program was telccrf I 
or during the tipc of telecasting. 
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x-x^ 10. Some ExplorAtorv Analyses 

^ a. iLLa...l-JlLlDli::^:^"^^° '"""^^^ ^^^^^"^ Achievement Scores. 

To this point all the analyses of the in-school viewing 
experiments have been in terms of the paired classrooms. The 
reasons for this were that the sampling and randomization 
took place at the classroom level, and, therefore, the class- 
. room should be the unit of analysis; that the evaluation is 
primarily concerned with whether the show is useful as a part 
of the classroom's reading program; and that the initial 
analysis of variance indicated that differences between 
classes were greater than differences within classes. 

Despite the logical and enpirical reasons for these 
classrooms level analyses, it was also decided to investigate 
the effects of viewing on individual children from different 
levels of reading achievement in order to discern which groups 
' of children (rather than which classes) were benefiting 

from the show. Tnis analysis must be seen as an e:cpioratoi.-v 
look at t:.c data since it ignores the pairing of classes and 
their randomized assignment to treatment. 

An analysis was carried out in which children in each 
in each grade were classified into ten equal group, (decile r) 
acccrdin,; to prot.-^t Metropolitan scores. Of course, the 
poor.r reading Ci..r.sroo:ns contributed disproportionately - ■ 
r.->ri5<-rs to the lower deciles and the better reading classro.- : 
contributed disproportionately more members to the upper 
dccllor.. Note that in deciding on the cutting point on th.' 
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Metropolitan, both sites were combined. Thus the range of 
scores encompassed by each decile is the same for both sites 
and the results for each site can be properly compared. 

Tables 42a-d present the data separately by grade for each 
site. For each grade the number of viewing and non-viewing 
children i.i each decile is indicated along with their mean 
pretest score on the Metropolitan, their mean protest total 
score on xhe Electric Battery, and their mean gain (or post- 
test score for first grade) on this latter test (along with 
the respective standard deviations). The critical comparison 
in each grade and each site is between the gains of the 
viewers and the gains of the non-viev>'ers (except in first 
grade where posttest scores are compared). 

Results for all four grades reinforce previous analyses 
that showed effects of the shw^ on viewing classes. In 75 
of the 80 decile groups (ten deciles, four grades, t\vo sites), 
vle^'ers gained more (or had a higher posttest score) Lhan 
non-viev7ers . Results in all deciles in all grades see:-; to be 
fairly consistent and indicate positive effects from vi rawing 
even when the size, of the effects do not reach the .10 lovel 
of significance. The one exception to this might be in docile 
1 in all grades where children on the Metropolitan pretest are 
scoring at or below chance level and where effects due to view- 
ing seem to be minimal. 

There do seem to be some grade and site differences. 
In first grade the sites differed in that the show seemed to 



139 

have the most effect with the poorer readers (lower deciles) 
in Fresno and the better readers (higher deciles) in Youngs- 
town. In second grade the lower and middle de.ciles benefited 
most in both sites. In general, the target groups (mainly 
those in deciles 1 through 6) seem to be benefited more than 
the non-target groups. The third grade decile analysis shows 
significant results spotted across deciles. The fourth 
grade decile analysis replicates the original analyses on 
fourth grade and seems to indicate the non-target fourth 
graders benefiting more than the target children. 

In order to see where the show is having effects using 
gains on the >Ietropolitan as the dependent variable (as opposed 
to gains on the Electric Battery total), a second set of decile 
analyses were run and are here reported. (See Tables A2e and 
f). The class- level analyses indicated that significant gains 
were made on the Metropolitan by viewers in comparison to 
non-vie.v'ers only for first grade classes in Youngstown. This 
less precise but r.:oi.e detailed set of cnalyscs will examine 
the differential Metropolitan posttest scores of viewers and 
non-vic-.-of-:. Only rc^sults for first and second graders will 
be presented. 

In llryt g:c.dc i:i Ytchv.o v.-hcre L'.ie ovornl.l ar.alysis 
shwed no signi : : c:.:it effect of the shcr,; on the Metropolitan, 
throe of the ten decile comparisons were significant (deciles 
2, 3 and 10 at the .05 level). In seven of the ten deciles. 



viex^»ers had higher Metropolitan scores at posttest than non- 
viewers (at pretest the figures were two out of the ten). 
It is interesting to note that the three significant deciles 
(2, 3, and 10) overlap consistently the four deciles when 
the total score on the Electric Battery was the dependent 
variable. That is, effects of the show, assessed by the 
Electric Battery, seen to generalize to the Metropolitan. 

In first grade in Youngs town there was even stronger 
evidence that children who viewed the show gained with respect 
to Metropolitan scores (deciles 2, 3, 6, 7, 8, 9, 10 showed 
varying levels of significant, positive benefit). At every 
decile the viewers had higher posttest scores on the 
Metropolitan than the non-viewers. At pretest this was true 
in only 5 out of the 10 deciles. 

Tne second grade decile analysis of the Fresno data 
also provides evidence of significant effects on the 
Ketropolitan. Tlnee of the ten comparisons were significant 
(deciles 6, 7, and 8) and every decile shOTed viewers with a 
higher posttest mean Metropolitan score than the non-viewers. 
A snaller pondtive effect was noted in the second grade 
decilo analysis of Youngstown children'. 

'ihese analyses look at achievement level at pretest in 
roLalion lo benefit from viewing. It seems that; there is 
evidence tliat the show is benefiting not only classes but 
also certain children at different levels of reading achieve- 



nient. There Is also evidence that a small but generally 
pervasive benefit is accuring to scores on a standardized, 
normed reading test — the Metropolitan, 
b. Intercor relations 

Many variables were assessed in this study because it 
was thought they ri^ht be related to the gains resulting 
frc:: (,lw^..€r' vi <.vlr-^ X:\f s:.cv;. T:\^re, variabJes were 
re^^',xccd as poCcnLidly r.ocic rating the effects of the show 
and they izicluded: 

1« icars of uducatioa 

2* NiJihcr of chiWrzn in cl-?> 

3. Years of teaching e:-cperlcace 

A. Percent of tir.e spent on teaching blending 

5. Percent of time spent on teaching letter groups 

6. Percent of time spent on teaching sight words 

7. Tcrcent of time spent on teaching scanning 
S. ?(.; cent of tr r ? oront on ter>^?hir.^ morphe'>'^s 
9. Tcixeiit of tiir.c spent on teaching syntax 

iO. Percent oi ti::.c spent on teaching punctuation 
!!• Percent of time spent on tc^aching context clues 
1?. Tc::chor c uo? tlo'snaire indices 
I3» ywoojitcc rates 

In oruu-r to see if these moderator Vi»riab]cs were relalod 
to t];e classes* gain scores, correlations bet^^cen the variables 
and gain scores (with pretest scores partialed out) were 
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calculated separately for viewing and non--viewing classes. 
If the variables were, in fact, a moderating influence on 
gairLS due to viewing, then the partial correlations between 
them and the gain score should be significantly different 
for viewing in contrast to non--viewing classes. For 
example, if tiiae spent on teaching phonics in second grade 
were to have a inoderaLing, beneficial effect on gains due 
to viewing Tne Electric Coir.pany , then the correlation 
between time spent on teaching phonics and gains (pretest 
partlalled out) should be higher for the viewing classes 
lixun for uhe ncn-vic.s ing cli^^scs, 

A series of contrasts (viewing minus non-viewing 
correlations) wer.e carried out to check on the variables 
listed above. In fact, only about five percent of the 
contrasts were found to be significant at the ,05 level 
and none seemed to be consistent across grades or sites or 
o^::t;c:i;.nl \7icli Lriji^r^aLi expectations. It was concluded 
that none of the varicbles studied seemed to have a strong 
and consistent relationship with gains to be derived from 
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Analyses of the At-hone Vlc.-in-^ Exp ert mpn^c 
1. An Overview 

The results presentc-d in this section of the report concern 
the two sites of Rlcfmond, Virginia, and Washington. D.C. In 
both sites pairs of clarses in grades one through four were chosen 
and one member of each pair was randonly assigned to the 
experimental treatment - encouragement by teachers to vie. Zha 
Electric Company at home after school. The nunbers of classes and 
of children Involved in each site and son<.e demographic infon^ation 
have been pre-e-ifed carUev in this r:,.c-r-. Table 12). 

Table 43 presents a break out of the demographic data by 
experimental (encouraged to view at home) and control (not so 
encouraged) treatments in each site. In each site the character- 
istics of the encouraged and not-encouraged groups are very similar 
on virtually every tabulated categor izaiicn. 

A comparison of the sites thenselves reveals some differences. 
Considerably more pairs of classes wer.- lost to the experinent in 
Washington than in Pichr.ond (eight pairs one p.ir respectively), 
rne loss of classes In Washington was due to the decision in one 

school to intr-Vv - ^^v- ,i y, ,,.: ^ . . 

. vxc .ng CO iM)..: cncouragec and not- 

encour..,;c:d cla.«c.. .\s v.c-ii. the attrition from pretest to post- 
test was greater in Washinstron. primarily in cue r.chool that was 
located near an air i..-ce base where personnel with school children 

were r.loc.tcd and m a.oth.r two s<h.o].s that were located near 

sor.c public hoa-jlng that was closed down during the year. Thus. 

the nu::Mor of childr.:. in the .tudy (both pretested and posttested) 

Is 22iJ7 in Richmond and 1648 In Washington. 



o 



144 



The sample in both sites has a preponderance of black chil- 
dren; this is overwhelmingly so in Washington where over 97 1/2 
percent of the sample is black (all but 29 children). Almost 
all the children in both sites had an English language background. 

Target children heavily predominate in both sites. All first 
graders are by definition target children; in second grade where 
a target child is defined as being in the bottom half of the 
population in reading achievement on national norms, there are 
almost four times as many target as non-target childrpp. In third 
and fourth graces, target children (lo^cest quarter in reading 
achievement on national norms) predominate over non- target children 
by almost three to one. Site differences clearlv emerge here, 
however, with the saiTipled diildren in Washington having a greater 
) percentage of target children in third and fourth grades . Note 

that the sar.nles are not representative of the school systems 
from which they were taken. A deliberate policv was established 
of looking for schools and classes within each site where target 
children were pi*edo:rdnr.nt . 

The experimental treatment of home viewing was carried out by 
encouraj;c:nenL of cliiidreii to view. Ihe thesis of the experiment 
Vc^s that the first major impact of encouragement to vieu* would be 
gV'^nter viwi- ^, r.nd the ir.pact of greater viewinn vrould be greater 
irprovor^Mit in sevens ax'eas of reading achievement and attitudes 
to reading, llius, actual viewing can be thought of as a dependent 
variable in a two-phase e>q>erl;ijent . If encouragement to view did 
not produce greater viewing of Tlie F.lectric Corr^nny, then an 
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examination of the data by this treatment would probably not reveal 

* 

the effects of viewing. 

Evidence about the amount of viewing that occurred is available 
from the two measures of viewing used in the evaluation. Tables A4a 
and 44b present the information on the children's viewing of The 
illectric Cor.oany obtained from the posttest parent questionnaires 
in rd.chr.OLid and '.:asaington respectively. Embedded in the posttest 
parent questionnaire were questions on whether the child ever watches 
The Electric Company , how often, how much of each show, and whether 
the parent watches too. Unfortunately, the response rates for the 
pCwtl:..st p3:*c:rt c v£.:tIonr..'\-':re vore rather low, especially in 
Washington. 

Percentage of Parents Responding to 
Posttest Parent Questionnaire 

Richmond Washington 
Grr.cle E ucoura^- cd Not-encouraged Encouraged Not-encouraged 

1 71% 43% 50% 46% 

• 2 60 61 49 46 

3 74 75 29 36 

A 5.0 50 42 32 

TiiG: rcr."c : ■ f rates arc, in g<^noral, similar for encourap.ed 
and not-encouraged cldsses in each site (except in Richmond grade 
uiic). .:c^c\\'Vy \:^'U cw i- half of the War-lungton ^'arer.ts and about 
oiu-lhii\: t'.iC Ric*n:r,o:id parents did not return posttest question- 
nal r<-s . . 
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Evidence about the amoxmt of viewing of The Electric Company 
is also available from the viewing records. As these were 
collected from the children theinselves several times during the 
year in fthclr classes, response rates were considerably higher 
than those from the parent questionnaires. 

Mean Percentage of Children within Classes for 

I. ■•*. "-crn -i'. C btarned 

T..-^-,.- Washington 
Graae xjRCOui^^,ea c ^iLi^ — 



3 



59 .3% 
97,0 

98.5 



98. A 
100.0 
99.6 



64 
37 
82 



69 
47 
54 



In Richmond, at least one viewing record was obtained from 
vir::ualiy every child. In Washington, 24 classes had no ^aewing 
records so then the rA-rar,e return per class is substantially Ic". 
.- T-- .- - - . ' • v^\L=> ccnic'r-rablv fron grade to grade. 

The follo-.-.-ins ahsLr.icL i ro:n i les ^Aa and A4b li^ls the 
percent.^^.: of rosp.-r. :i p:.rei'is v;:.; indicated that their chilc^r, 



"nrr-nt-; Tndijcatvno Child ren Viewed 



1 
2 
3 

4 



C6/- 
62 
69 
6'5 



5c»M 
49 
43 
4? 



'„'ashir.::'on 

4o;-, 25-. 

39 36 

39 44 

52 38 



i! 
>=• 

i. 
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In Richmond the responses indicate that differences in amount 
of viewing between encouraged and not-encouraged classes were 
present — but were not large. In first grade the difference is 
quite small (eight percent) but rises to over 20 percent in grades 
three and four. In Washington the levels of viewing in all grades 
were lower than in Richmond. Note that differences in viewing 
rate of the encouraged children is substantially different from 
that of the not-encouraged children in only two grades — first 
(15 percent) and fourth (14 percent)r. In the second and third 
grades, encoiirageir.ent seems to have had no appreciable effect on 
viewing, the not-encouraged in third grade actually viewing more 
than the encouraged. 

Tlie preceeding data are based on responses to a questionnaire 
where much data were missing. The rate of responses for viewing 
records was much higher, especially in Richmond. For each child 
with at least one viewing record, a view score was devised by 
dividing the number of timei, the child said he had watched The 
Electric C orn any by the number of viewing records collected. Thus 
view scores ranged from 0 (never said he watched) to 1 (always 
said he watched). Viewing record scores of each class were 
calculated by averaging the children's scores, llie following 
table represents the mean class viewing record scores for each 
grade in KichiTiond and Washington: 
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>fean 


Class Vicing Record Scores 












Rldimond^ 








Washington 




_ — 




Er.co'i 
.-. 








of 


EncouT.- ^cl 


If of 




Kncoi::\. ....... 


Oracle 




"sd" 


M 


SD 


classes 


M 


SD 


c lasses 


M 


s;j 


1 


.76 


.08 




.10 


4 


.51 


.30 


7 


.53 


.16 


2 


.69 


.17 


.61 


.12 


12 


.64 


.15 


12 


.55 


. 


3 


.70 


.18 


.56 


.05 


5 


.43 


.28 


5 


.64 




4 

1 


.56 


.16 


.45 


.17 


8 


.40 


.18 


7 


.33 


.7.2 



All Rich"ond classes included in these scores. 

v.-::/. C c r.urcut quas ti-unaire responses, the viewing recora 
scores indicate small difference"; bef -oen the ar.cvat of v ::•„•: r.^* cm' 
encouraged classes r.nd the not-encouraged classes. In Ricaaond, 
the amount of viewinc reported by children in encouraged clac:ses is 
greater than the amount reoorted by not-encouraged classes in everx- 
grade, but thi5, dif-'ereuco is sir.all , ranging forn .07 in fi-st 
Krade to .1^ in third grade. In Washington, differences are even 
snialier, and once a-ain the third rr u\^. not-»^ncour.-^ged cla."sos 
reported ro:o v,:c-.;lr,s tiian the encouraged classes. 

FAademe about ar.ount of viewing cf the Tne Electric Co-.anv i.-. 
.-•...cj :.,.J^ie sets of data. While the effects of the missinp. 

data on these analyses i.; rxct calculable, it appears from both 
--ourcrs 'h^-t tlu-.rc- v;a.s little ciffor-nce in ti.c a.T.ount of vie-..ing 
lhat took place in e -ouraged and iv.t enccurar.od clnsF.cs. In effect. 
Ihi. C'.-.n, ri:.i:it. iailcd and viiile analvses of data bv encouragement 
will tell littJe about the effects of vie-..lng, these analvses will 
be presented lor the purpose of compreheasive reporting. Later 
manipulations of the data will be pre-.onr.-d that atter.pt to 
discover effects of viwing. 
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An overview of the results of the at-home viewing experiment 
is here presented in Abstract VI. These results are based on data 
from The Electric Battery test of 123 items (except for the pretest 
in first grade where only 24 items were administered). 

It can be seen that again the decision was made to keep grades 
and sites separate. This decision was made in order to keep the 
analyses and reporting of the at-home and in-school experiments 
consistent and to overcome the problems that emerged when it was 
found that amount of viewing was distinctly different in Richmond 
and Washin^con c.nd i\.az differences in "pretext levels of 
performance existed be'^veen Richir.ond and Wrshington (favoring 
Richncnd in fii^l ^vid fourth grades and Wa-hin^ton in second grade). 
As well, in Richmond the classes constituting the sample in one 
grade carr.c fron a substantially different set of schools than the 
closscf^ c:or:tituti:^g the sar.ple in a different grade. Clearly, 
collapsinr. data across grades in Richmond would present problems. 

Ine pretest, results indicate that in both sites at each grade 
level cac i\ r.uc:. i .:,..ti a process had the df-^Jrod effect of obtain- 
ing reapor.ably coirparable encouraged and not-encouraged classes- 
'ilici 3;iriv^.r>t difference at pretest beDv'ccn encouraged and not- 
eixouragod cl:^scc3 Ls 2-8 points (third grade in Richr.ond). Five 
of U:v c:/ I t. -t. c L I favor Iho e-irournrcd grovrs and 
fh^ vc f /or t.:.c iiot-'-< :..,0'jr"..;c<!. Also pr -onted in Abstract VI 
arc I^^^•.ttost, r.^in, and the difference betveen the adjus ted gain 

of c:^--i:ra4- ":id not-on -onrai^c J pairr* of classer and their 
i\ .T.'Cti'c' iitandard errors. 



i 



C 

c 



♦J jO 

< > 



cn 
0) 



o 



3 



: i 



w 



c 
c 



CO 

a 

00 

a 



I 



00 CM O ^ 



O vO 

in lo 



ON in <r 00 



vo vo o m 
vo vo 



CO -sf 



cn CM 
I 



u 



OD O CO 



cvi vo cn CN 



li 

52 



f-H CO CO 



cn fo o 



O H r-i cn 
• • • • 

<r 00 -cr CN 

00 00 I 



CM O 00 i-H 



r-* CN O CN 



H CN 



CM 

C) • « « • 

a\ vo CN CN 

in in 

o 



CM O 0% CN 



CM 

o 



CO 

u 



CO 

a 



ir 4 CN cn 



<■ o> vn 
• « • » 

vD m o o 



vo 00 
CN iH 



^ fH VO 

• « • • 

^ ^ cn H 

CN CN 



i-H fO CO 



CO 00 



CN m «<r 



CN i-H 

vo vo I 



a 

c: 

I 

o 



CO 

u 

•H 

a 

ON 

It 

2: 



H CM 



ON in o 
• • • • 

H O H CM 



CM vO vO 



rH f-< iH 

o o\ 



cn rH CN vo 



C>. CTk O H 
00 « 



cn[ 





•H 




































CN 














ON 








C7N 





C7N H 
d H 



i-H CM 
> • • • 

O O O iH 



CN 



^ in CO <T 



O vo fN fM 
00 CO 















:i 








c: 






o 




4J 








ITj 








f : 






•VI 








o 


♦J 
















w 






u 




rj 




rJ 




o 


1 


o 


o 


u 




a 


r. 


o 






w 




w 





u 
I 

o 

w 

f« G 
0) D CJ 4-» 



U 

I O O 

*-» a 



U5 W V5 



r 

♦J 

o 



11 



CO O cj W 
« $^ 

I O O 



3 

o 

a 4J 0 

c: c r. 

w ;c w V, 



u 

•H 

CO 



ii 

2: 



o 


vo 


m 


VO 




« 


• 


• 


vo 


VO 


o 


rH 






1 






CN 




CN 


« 


• 


• 


• 




CN 






o 


O 







i-H fv. i-H 



CO O <M rH 
ON CTN 



CN 



O rH 
I 



to 
u 



ex 



o 



Ii 

52 



CN CN O O 

« • • • 

to VO iH H 
I 



O CN tn 

« « • • 

in iH fH 

o o 

r-l fH 



in CM CO 



iH ON CNJ rH 
O ON 



a 

a 

0) 

I 

u 
o 



w 

G 4.J 

00 a: (0 

CO 

D O 4J 

O :.o y) 

CO a CO W 
C u 

O o 
o u u 

;^ o c: w 

w ^ W CO 



k4 

O 



(0 
0) 

u 

<D 

a 

iJ 
I 

<r 

CM 



erJc 



151 



At posttest the encouraj^ed classes performed at a higher 

level th.>n the nct-(-ncoura^ed cl::oses in seven out of the eight 
experiments. The exception was in second grade in Washington. 
However, after adj'JSting for pretest, the difference betv/een the 
gains of the encouraged and not-encouraged classes favored the 
encouraged in only five experiments (first, second, and third 
grades in Richmond and third and fourth grades in Washington). 
None of these adjusted differences is statistically significant. 

T:\r:e rosi;lr<^.- arc in stronr, contrast to those obtained fron 
the in--school vie^^ing 5?tudy where every one of the eight adjusted 
gain scores significantly favored the viewing classes. It is 
important for the overall evaluation that possible reasons for 
the different results be discussed. 

One ir.pcrter^l rcacon is clearly the effectiveness of the 
e>nDeri!nental ir^^.nipuJation — encouragement to view the show. For 
the ill-school vie.;ing experiment all experimental classes viewed 
tiic: vast rijority of the ^ha.'s. For the nt-ho:r.e vieviug experiment 
the data on viewlnj'; already presented indicate that encouragement 
T<.r^llz: 5-} vvi.' : 11 d:ffc ^rc-; in aro-jnt of viewing be fwcen 
encouxaijjci nol-ci.c.v.n ogc>d clasr-es. 

The qn?<'.tion of whv the extra learning did not take place seems 
clearly bound ii, lact that there \^Lr. very lit Lie extra vie.>- 
in(^> and ii\fs t\\n I'O lucotintcd lor in a nir ^or of wavs. Consider a 
hypothetical pair of second grade cla^soi;, une class randomly 
afjsi^aec! to bu cncount^cd to vif-^^ and the ut'ner not to be so 
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encouraged. The figures indicate that within the not-encouraged 
classes in Richmond about 50 percent will view anway of their own 
or their parent's volition. Presumably about the same percentage 
in the encouraged class would also have viewed anway, ThvSy the 
encouragement is presumably directed towards the other 50 percent 
of the encouraged class. Some of those children may not want to 
watch television at the time of the late afternoon showing of The 
Electric Company — perhaps they are playing or working at some 
hobby. Others may want to watch but their telovision cannot 
receive the ur/ diaimel transmitting the show. Still others might 
be susceptible to the encouragement and have a set capable of 
receiving the she;, but older siblings or parents want to watch 
some other show. Those who are left ~ those who can and mav view 
the show at here and who are susceptible to the encouragement — 
i-eprc-.ent the c. ! f f orr.r.tial over ti^e viewers in the not-encouraged 
classes. If the show had been less popular (say only 10 percent 
of the not-encouraged had viewed) the differential would probably 
h::vc bocn l^r^cr. In acldilion, soiree teachers reported that they 
discontinued encouragen-.ont when they discovered that substantial 
numbeis of chiJdron could not see the shov because of reception 
c]^fficultLe^, Encouragcir.ant was not an all or nothing treatment. 
Another pc.^-^ibility exists. The kind of vic-.^^ing that occurs 
at ho:ve nny be loss directed at the goal elements and less 
followed up and further reinforced than the kind of viewing that 
occur.s In school. Tin's possibility will be further disciwse.d 
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when analyses of these data based on ar-ount of viewing are 
presented later in this chapter. 

It is further possible that the failure to obtain positive 
results with classes analyzed as a whole clouded a significant 
finding if classes were split into target and non-target 
components. As in the in-school e:<perir.ent. classes were divided 
into these two components. In no case did .ricuragc .r.r.c have a 
significant effect upon total score. An abstract of the results 
by target and non-target components is not presented her. but the 
relevant. t.Mcr. in Volure 2 of this report will be listed and 
described in the foilov.-ing section. 



a 



c. 



Analv. es of the At-Hn r^. Vlc^.-ing E>n^oritnent .b>'_^rade 

Altho-..,'.t the overview presented ir. the previous section of 
this chapter showed no significant results were obtained in this 
study, it is scill proper and relevant to present the results in 
sone detail. In order to obtain a picture of the specific effects 
of Tu.e rl-c^rlc._Cor/^anv on fitot through fourth grade classes whc 
vera encouraged to view the show at home, the following tables will 
be c-:.%rinod: 

.-..4 /.rvj r/..--c''. p-csent the t>retc^:t, T^osttest, and 

dj^t^ted scores for encouraged and not-encouraged first grade 
.lr.~s.cs in Richmond (A5a) and Washington (45b). 
-Tables 46a and 46b which present the pretest, gain, and adjusted 
scores for encouraged and not-encouraged second grade classes in 
Richr. jnd (45a) and Wa -hington (45>). 
-Table 47 v;hich presents the pretest, gain, and adjusted scores for 
tP.rc^r r.nd non-tar^^et components of encouraged and not-encouraged 
second gradv classes in Richr.ond. 
-Tobies 48n and 48b which present the pretest, gain, and adjusted 

..• •,■-1 r-t-c—o 'rr.i'cd third grade classes in 
scores tor c.acoui.c-„v'C a...i i. l (-..^u-..c o 

Richr.Oiid. 

-.-T.:b:...-5, ■'."<: p.ni which ^ro?cn^ the pretest, gain, and adjusted 
scores for target r.nd non-target con-.ponent:s o£ encouraged and not- 
encura^.d third grad. classe. in Richmond (49a) and Washington (•■ 

-Tables 50a and 50b which present the pretest, gain, and adjusted 
scores for encouraged and not-encouraged fourth grade classes in 
Richmond (50a) and Washington (50b). 
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—Tables 51a and 51b which present the pretest, gain, and adjusted 
scores for tarrct and non-target components of encouraged and not- 
encouraged fourth grade classes in Richmond (51a) and Washington 
(51b) . 

—Tables 52a through 52h which present the pretest and posttesf 
teacher questionnaire scales and selected items for encouraged 
and not-encouraged classes in grades one through four in Richmond 
(52a-d) and Washington (52e-h) . 

— Tables 53a through 53h which present the results of observations 
of reading lessons in iirst througii foui>h grade encoura-ed classo. 
in Richnond (53a-G) and Washington (53e-h) . 

—Tables 5Aa and 5Ab which present the pretest and posttcst parent 
questionnaire scale scores for encouraged and not- encouraged 
children in graces one through four in Richnvond (54a) and Washington 
(541). 
Firnt Cr:>.di: 

The d?rn for tin-: experiment are based upon ten pairs of classes 
ir. Ricl-.:,;ond <,...J oig-.t paii.-; .La "aih: : l,rc.:. In-'- nr. tc.^t scoro.. in the 
tro rite? '.-rrp -..;^-.?r>r.tipn-/ different. Note too that the amount of 

•. . Q,- , :■>- .f;-: C - - • • was co'.-.siderabiv Jower in both encouraf 
and nol-en<;ourr.^cd clao..cs in UaShiuston ti-.an i:t :Uch;';ond. Of all the 
<,U..i...L:cal <•. rri-.- ov.L pu 'J.c- to.u ^.c sr.rst.c, cr.ly cno 

..i . -..iric.-.-.l. i...c.ivi ,.-. occ..sior.::l i --i-f i --"-"If 
c>:ptctcd by ch.'.noc- wheu raltip'ie contra-. ts are made, this result was 
,. ; ooii,:a-;. ! : • .r.ln .ful. 
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Ihe average number of children who were both pretested and post- 
tested per class was quite different for the two sites. In Richmond 
the average was about 22 children per class; in Washington it was 
between 17 and 18, This reflects the large attrition rates in three 
Washington schools « 

Observations of the encouraged classes indicated a somewhat greater 
c. ..w>c>i : ::^cs ::: ra.c..::.ond tiiOii in Washington; but this does not 
seen to b.' particularly relevant information for this evaluation since 
neither si^e provided evidence of significant experimental gains, 
Sii.J.iarly alUiOugh uhe parent questionnaires indicated sor?c=--hat greater 
<wjiorC'» r.: c..'/.or.f! -.t.rzv.z^, cci.p^ vucl v:it:i the '.;ashingtoa sample, 

no sidc^-effecli, of the experimental treatment could be discerned, 
fe^cond__Gr?de. 

The data for this experiment are based on 20 pairs of classes in 
Rich:r.ond an:l IC peirs in Wnshington, lu Richmond there was some 
evidoncs of poi^itive effects of the sha-;. The adjusted differences 
in -air<- for tiio tclr.l score, incivi uai lo.al score, and blend- 

i;j:i tcL.-.l vi-i-^ .significant at the .10 level. The effect soemed to be 
clc^arciol v:ii;? sj^^lM word:? and context vocabulary. These results have 
a Jo^^ic to ther) in that the^o two srbtc^ts ,isros/ a r.lr.)il.,r loading 
<;k5n. i:;:-- t:'0 tMz^^v r-^ ;::^n-uar^-r co--c:K.nt: v:rc broken out 
thi.:: .-:..c.il exiocL /c.v.aincd for the grand total. 

caiisei-vauive and that failure to obtain strong sl(;nificant results in 
this analysis doer> not i:.onn the shfr»^ is ineffective for those who 



157 

view — merely that encouragement to view pi'oduces a relatively weak 
enhancement of the amount of viewing and, in turn, produces few 
measured effects. 

In Washington, the second grade experiment was the only one of 
the sixteen conducted for the evaluation in which the not-encouraged 
classes had a higher mean posttest score than the encouraged classes. 
An investigation of the pretest, posttest, and gain scores for each 
of the individual second grade classrooms revealed three in which the 
mean scores decreased from pretest to posttest. While errors of 
'^e?5ur otter. t rlj^ht account for subjects at the extrr::jes of the test 
score ranj,e aavixig a lo;ver posttest than pretest score, for three 
classes to move backwards and for all of them to be in one of the 16 
experiments (four grades by four sites) is a highly improbable occurreaca. 
It was noted that each of the three classes was posttested by a tester 
who, after discussion with the coordinator, had quit her job midway 
through the posttesting. We felt it would be improper to omit classes 
seleciivciy froir. our data zo all data collected are here r.-ported. 
However, these second f*,r&de Washinf»ton rosults are presented without 
great confidence in their validity. It should also be noted that even 
if Ihe tlireci classes t.hich hac neg<.Live galas -.'ore cxcluvkd from the 
dtiLJ , ihe oveicill conclusion of i.on-Bi f Icnnco would remain. 

Thi rd ,->nd Fry.rrh ^j-rVx- 

It if., porli.'pt;, noL i,urpri in;', that no positive results were 
obtained in the third and fourth grade at-home viewing experiments. 
Even in tiie in-school viewing study, where all experimental classes 
viewed and control clai^ses did not, the results, though stntistically 
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significant, did not show large differences between the two groups of 
classes. In the at-home viewing study the difference in amount of 
viewing between encouraged and not-encouraged classes was quite small. 
Thus, one would expect, at best, only small differences in their 
respective gains. In fact only small differences were observed and 
none was significant. 
Teacher Questionnaire Results 

A number of variables to be fionsidered in relation to the results 
of the at-home viewing study is to be found in the teacher question- 
naires (Tables- 52a-h). Completed questionnaires were obtained from 
all Richnjond teachers at pretest and at posttest. In Washington, all 
teacher^;, cov.-.pleted their posttest questionnaires but the number of 
completed pretest questonnaires was considerably less. 

Since positive results were not obtained in the at-home viewing 
experiT cnts cr.e night speculate whether positive results were hidden by 
<5ome kind of negative interaction between the regular reading program 
and the books used in class on the one hand and The Electric Coroany 
on the otf.er. 

In Rich:;ond all teachers used the same reading texts (the 
LippincoLt: r.-^sic P-aders) in first througii third grades. V.nile there 
was sor..e d.-.ersity in fourth grade the scries ed in the earJior grado^ 
sLlll p;cJo:v.ir.;i;. Tn '.Cash: nf;ton there was greater variety In the 
texts u--.cd, thou,,b for fivot grade the Bank Street Kciders were most 
popular. Neither these books not the ecic.ctl c-phoni c approach to teach- 
ing notod fron t!u- classroom observations seemed particularly different 
in emph.':.s!s th,-,n those noted in the at-home vie.' Ir.;-. experiment where 
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positive results were obtaired. Thus, it was felt that there was little 
to be gained from further scrutiny of these data. 

Many teachers in our Richmond and Washington samples watched The 
Electric Company at-home after school and their attitudes toward the 
show seemed very positive — if anything slightly more so than the 
attitudes expressed by the Fresno and Youngstown teachers. Nany felt 
that the show should be seen in school and this opinion was most strongly 
expressed by teachers who knew that the UHF transmission prevented some 
of their pupils from viewing at home. 
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Analyses of the At~hon;e Vievylng Experiment by Viewing Groups 

Throughout the results chapter to this point the data from 
this evaluation have been analyzed and presented In temis of the 
experimental design which Involved paired classrooms and random 
allocation of pair members to treatment or control conditions. 
Tne rc:sults obtained from these "true" experiments can be 
interpreted with relative e^se in that many potential alternative 
hypotheses and explanations for results are precluded by this 
kind of design. 

However, with the at-home viewing experiment it was seen that 
Uu. aLOurit of treat:: ent (vicvir.f^) was not radically different for 
the experimental in comparison to the control classes. That is, 
both groups of classes viewed The Electric Conipany at home and the 
differences in their amount of viewing were not great. Therefore, 
it was decided to analyze the data in quasi-experimental ways 
in order to attei^pt to extricate the effects of vievs'ing and of 
encourc^^t'!... r.l tc vie. 

Amount of viei^lng is a difficult variable to assess in large 
field experi:::C;nts . Even if the experi.ment had been confined to a 
few cliilcVen tho be?:t technoloo^ for assessing amount of viewing 
of a pc.r':i v]\c.: voi:lc! hava provided an expensive and still 

imperfect irc»;isure. In our extensive study of more than 4,000 
childruii i\L>r. sora 20/ cla^,srooi».s it was i\ot posGible to install 
meters on home sets or to arrange for other forms of checking on 
vic\^an^;. Instead, os presented in the previous chapter, amount 
of vtc'.'.'lii; wnfi a/,sos5;cd v:lth two different instruments — in the 
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posttest parent questionnaire where parents were asked a series 
of questions about their children's viewing of The Electric 
CoTT.panv ; and in the viewing records where children in their 
classes were asked on a number of occasions during the school 
year to indicate, from a selection of popular television shows, 
which ones they viewed. 

Note that not all posttest parent questionnaires were 
returned, not all children were present when the viewing records 
were being collected, and not all classes were cooperative in 
fi]]lno; out vl earing records. Aniount of viewing was assessed by 
eid.'^r or both i.^thods for the following numbers of children: 

Mchir.ond Wash in;^ ton 







No. of 
subjects 
ia total 


No. with 
viewing 

r.aasi're 


No. of 

subjects 
in total 

sample 


No. with 

viewing 

measure 


Grade 


1 


452 


452 


287 


233 


Grade 


2 


938 


924 


629 


501 


Grade 


3 


410 


407 


3A2 


193 


Grade 


4 


487 


482 


390 


290 



In Rich;:ond 22 su;)j'.'ctG hc^d no vicving measure and in Washington 
^i31 had none. Those with at least one viewing measure were 
assigned to groups on the following bor;es: Xon-vi ev^ers (NV ) 
were children who had a completed parent Questionnaire and/or 
viovin?; record s^corc indicating thai: the child had not viewed 
the show. Group 1 viewers (presumably about 1/4 of the shows 
wtire viewed) were so categorized if they met these conditions — 
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Parent Questionnaire Viewing Record 

Score Score 

5 and 0 or blank 
0-4 and/or .25 
0-3 and .33 

1 and . 5 

Gro w 2 xic '^evi (presumably about half the shews were viewed) were 
so categorized if they met these conditions — 

6 and •25- ,50 

5 and .25-1 
0-4 and .33-1 

blank and .5 

Group 3 viewers (presumably about 3/4 of the shows were viewed) were 
so categorized if they met these conditions — 

7-8 and . 75 

6 and .75-1.0 
6 or .75 

8 and .667 

Group A^/i>vero (presumably alnost all of the shows were viewed) 
were so caLcgoiizea if tl.ey had a viewing score of 7 or 8 on tlie 
parent quosrionnaire and/or a score of l.o on the viewing records. 

T::blc 55 presents th^> pretest, posttcst, and gain scores for 
€>nch zrr.do by vicn/inf ^'xoups separately for children in Richmond 
and Washington. The scores of encouraged and not-encouraged chil- 
dren are collapsed within each of the vlevring groups. It should 
be reraenibered that in this examination of me data the viewing 
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groups are self-selected — the cliildren and their families decided 
how much viewing of The Electric Company occurred. The pretest 
scores of the second most frequent viewing groups (V3) are 
consistent-./ the highest of all groups (except in third grade in 
Washington). Apart from the pretest superiority of the V3 group, 
the pretest scores of the other viewing groups and of the non- 
viewing gioup seem quite siniilar overall. An examination of th^ 
posttest and gain scores arrayed in Table 54 suggests no 
systematically different results in relation to amount of viewing. 

Table 56 presents the results of univariate analvsos of 
covariance of these data separately by grade tind by sita. Tnese 
analyses attempt to extract the effects of et.couragement and of 
viewing on the posttest ... ccrco adju.'^ned for pretest scores. This 
car be done because there were children in al] vi^^l.'^ groups who 
were encouraged and others who were not-encouraged. 

In each of the ei^ht experiments (four grades by two sites) 
the protost. covoriate, as expected, was seen to be signi f icantlv 
relatf^d tc the posttest score. More importantly for the evaluation, 
|in only one cc .e (Washington, grade 1) was there a viewing by 
cncoumgemcnt Inler^.ction. 7* i.s suggest?? that the rc-l atiionship 
bo--\;ce:: jc^ttcst scoros aivl arount of '^ae,;iug \:as different for 
the treatnont group. The main effort of vi'^v^ing, distinct 1-rom 
cncouragcni'jnt , w<'is s.^.iLiicanc only in Washington, second grade 
(but the data there have already been discounted) and in Richmond, 
fourth i-^rade. llie mc'iln effect of encouragement, distinct from 
vicvlng, w'lS significant in both sites for occond grade (though 
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this Included the suspect second grade Washington data) and in 
V7ashington for third grade. This effect for encouragement says 
little about the effects of viewing The Electric Company . 

The possibility of inaccurate viewing measures causing effects 
of viewing to become hidden in the preceding analyses led to some 
further investigation of the viewing measures. For those children 
\:],o hr/. bot'. ^\'(?'.:ing n^^asures, correlations bct\:ccn the measures 
were calculated separately by site and grade and were found to be 
oaly moderately correlated in most cases (averaging about .40). 
Analyses were done using each measure separately to calculate view- 
iri [r-ups, rn:l :.rain ::lie ra^ults inc'lcntec that viwing (whether 
r:taasuied by viCA-iiig records or parent data) did not seem to be 
related to rcadirg perforriance. 

The evidence for a main effect of viewing or for a main effect 
of exicourajjenent over the eight experiments is slight. Amount of 
\aeving, as assessed in this study, does not seem to ha* been a 
cij'.r.l flcar.L f-.cLor affc^cting the reading scores of children in the 
at-hoine experiment (irrest>ec':lve of whether they were encouraged 
to view or r.ot) nor does encouraging children to view the show seem 
to have had a significant effect on children's reading scores 
(irrorvpcctlvr of whether they vie'.%^ed or not). The at-home viewing 
study, ill contrast to the in-scliool viewing study, presents few 
po-,iti\o re;ii:lt..i. 11.. ".e diffureiiL results v;ill be discussed in 
more detail in the fin I chapter. 

Tn order to establish whether the results of the viewing group 
analyses of the at-aome viewing experiments held when target chil- 
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dren only were being considered, analyses were conducted in which 
non-target children were eliminated frcin consideration. This did 
not affect the first grade results as presented because a^l first 
graders were regarded as target children. Some modifications might 
be possible in the results for the other grades, however, although 
it would be unlikely that the modifications would be radical six:cc 
target children heavily predoniinated in the second, third, and 
fourth grade samples. 

Table 57 presents an overview of the pretest and gain scores 
of target chilcren by viewing groups in Sv.cond, third, and fourfh 
grades separately for each site. These res Its seem consonant 
with those presented in Table 54 when the scores of all sampled 
children (target and non-target) were presented.. That is, amount 
of viewing, as assessed in this study, does not seem to have been 
a significant factor affecting the reading scores of target chil- 
dren viewing in their homes. 

In su. ;nary, the at-home viewing experiment foundered when 
the encoui-agcd children failed to v±e.^ the sha-7 much more than 
the not-encouraged children. Thus the results from the true 
experinenC arrt uol interpretable. T>ie results of the subsequent 
attempts to extract rjeaningful results were hampered by amount 
of vie^'l ^ .-^coro?; that probably contained a considerable amount 
of error of measurement, even if vier,^ing were affecting 

the scores of the children, the impact on the scores, unless it 
were a strong impact, might not be discernible* Therefore, 
while it is true that there seeics little evidence from the study 



166 

that children gained from vie.'/ing Tue Electric Company at home, 
it is also true that the at~horae viewing study did not operate 
as effectively as had been planned. 
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A. Analyses of Attendance Records 

In order to see if encouragement to view THp Electric Company 
at home had a positive effect on the attitudes of the viewers, 
an -..nobtrusive, non-reactive measure — the classes' attendance 
re.- ords - was obtained. The reason for using this measure and 
tha problems associated with its use have already been discussed 
in relation to the in-school viewing experiments. 

The data for the at-home experiments is here presented In 
tabular form. It can be seen that no systematic or large differences 
in attendance between the encouraged and the not-encouraged children 
were found in either site or any grade during the September-October, 
pre-prograi. period. Sirdlarly, none were found during the November- 

May program period. 

Average Daily Absentee Rates of Encouraged and 
'>Nbj-encourcg.ed Classes in RichTnon d and Washington 
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At: was pointed out in earlier discussions of the at-home view- 
ing experiments, the reported viewing of the children in the 
encouraged classes was not much more frequent than the viewing of 
the children in the not-encouraged classes • Thus, one would not 
reasonably expect the attendance (or any other dependent variable) 
to be markedly affected by the experimental condition. 
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S a r-^ of Prolect Activities 

^ " * ^ ^^T-inc Th- Electric 

offpct<5 of viewing 

In order to discover soir.e najor ettects ox 

vete conducted 

Cjggw in Its first year of telecasting, two experl..- 

nvi-in In the other 
studied in Fresno, California and Youngstown. Ohio. 

,-.,eri..ent viewing aC home was studied in Richmond, Virginia and 
y.shington. D.C. also with first through fourth grade classes. 

i^ont- separate so that 
mroudiout the analyses, sites and grades were kept P 

or-afelv for each of the 
r.e effects of the shew could be estimated separately 

r-,.' L -o site^ for each 
four grade levels in each of the four sites, lac 

of the tvTo experiments served as experimental replications . 

^rc; of cl35=S rooms 

The experimental design involved matcnxr.^ F^^^ 
at each grade level and randomly assigning one member of tr.e pair to 

^ rhe pair to the 

the e>?eri..ental condition and the other merher of 

r^*- the in-school view- 
control condition, l^he e>Teriinental treatr.ent for t- 

-1,0 chow in sc-c-1 daily 
ir. experiment was to have each class view .he ^^Uow 

. period of si:c nonths. The experimental croacent ic. che at- 

.-t o?'rn^,e t*«i chil- 

: . viewing e>n>erinent wr.s to have f.ie teacncr 

X 1 fr.y^ a ncriod c: rix raonths. 
to v-c: rh. f^:.cv ::t ^fter -chool for n pe 

.:: Lilt' t-..'o in-^c.Ioa3 v:c.:ir.^ s^cc.-, 

^ iiO'^n be*' :- -n an 

. 'ho ->r;*ol c'ly <o that vic-^ing was contina-^^ » 

:'A teachers 

. cli^:>voo:,. In the two a'-hc:ne vmVK^:. 

:■ : .-i.t nor to smou tne pir,. 

. ...11 c-hiUlr.n, i:vperi:nar.ta] or control, poicntial.;- 

.... . u V ■■ that a h-'-r propor: -"a of 

, , ■ n Ml control .losses 

...il.icn In cncourant-d ci<usscs wuuld vae^ t--n . 



assrooir;:;*. 
ould vie./ 
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In .ach sit, the sa,^le 100 classes (50 pairings) of »hlch 
.0 Classes «ro no:, of first, third, and fourth grades and 40 

..^,,et" =hiWr«r. (i=fir.= d hy as all first graders, children In 
.... lo..-er half on national reading nor^ In second grade, and children 
t-,e lc--cst .uartile in third ar.d fourth grade), so that classes 
a preponderance of "target" children were Initially selected. 
Measuring lnstr»ents Included The Electric Battery, (a reading 

r-=r th- evaluation to assess reading behaviors that were 
'I^essed on the show. Including knowledge, s'^ills. and attituV.s to 
.,..a.r.). a nor.ed and standardized reading test, a parent ,uastlonnai, 
(„ assess ho»e background conditions, relevant parental attlttdes, a. 
television vie.in, habits), a teacher questionnaire (to' assess the 

■ . s-d--r--''3 r.-=thods of teaching reading, classroom 
c,.a^.ctoristics. .nd, vhcre appropriate, attitude, to the shcO . vie.i 
..coras (to assess he. .uch viewing was taUins place), and observation 
..cor... (to roccrd vhat reading areas w.re being taught in the rc.ul.. 
xv3.11:u: procr^n of c.:peri.ental classes and ho". th.y vera be::-. tnv.rV 
ccsiz- ^ pretestinr, before The_Electric_Coa'anv 

,r^.,r '^e end of the first sea.son of O-o -sh--" 
began ar.G a pcsttco uin^, a.^--. 

7 M- - ]-^r in the Interim, observation and attendance recor.!. 
vcre ccllected. 
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Sunmar v of the Results 

^* Hie T r^^-S ch CO 1^ Vf >r - r E>r>eri'^ents 



The data from the eight experiments (first through fourth 
grades separately in each of the tvo sites — Fresno and Youngs- 
town) were analyzed by comparing the experimental viewing 
classes and their control non-viewing pairs. The primary 
analysis was in terms of the gain scores from pretest to posttest, 
adjusted for the pretest scores. This analysis wp«. chosen when it 
was found that this estlnate was more precise than estimates using 
posttest scores or gain scores alone. It was found that the vifev- 
ing classes had significantly larger adjusted gain scores on the 
grand total than the non-vieving classes in each of the eight 
experiments. For the lower grades the differences were larger 
than those obtained in the higher .rades. It was noted that in 
the higher icradis eios. of the children pretest were already 
perfonning quite well in alir.cst all of the areas measured. 

Slr.ll.-r an;;lyser: vcre conducted broken down by target and 
non-target co~.poni>ats oi the paired classes. (Lote that all fir.-.-_ 
L-ra-icrs wt-.o co- -.i dercfl tar,-3t so that the rcsuUs obtajned on the 
Jir^t i:rr.:: cjcv.^ -. av:. id- r.ti cal v;: th the target conpon^-'.ts . ) In 
second, third, and fourth (irades it wai lound that both trirget a::.! 
non-t;iri;.^L co:., . : r-jc: .il bci.MU:.: sij.ii f ic-'-.v frcn th.:- 
shcr*' tii.-.j-:; t:„„. .sj>;e Lh- oifoct -.vc.j: 5 yn.c'-.'h,i t ]>,.er th-.n vhen r?.,- 
cl.'..-;.sc; wc i.. cc::sidc-rcd in rh-r: r entireties. Cvcn so, in only or- 
c:.: •...■i..;-r.t (Y. n-..-:^ ff;;:ri:, j-,r.;:-;- rnr;/.-t co:-:-en-.-:i ) v:.. -. the ef'.--: 

favori:.^; the vicvi:;^; clas-i--; I-.:;:; tiian tho <)0 perrenL ]..-\vl of I ^,■t^<■ 
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An exaiidnation of the subtest scores for each of the four 
grades for the in-school viewing experiment can be made through 
reference to the accompanying tabular presentation (Abstract VII). 
It shows that all first and target second grade groups seemed to 
benefit from the show over a wide range of goal areas. There was 
some evidence that for first grade classes this general effect 
coi.ld be inii-rpr^tcd in icr.ns of learning to read (see, for 
exar.ple, the siguificant effect on the Metropolitan test in one 
site and the significant impact over all four tests — blending, 
chunking, scanning, and reading for meaning). 

Tor CO*../ .onents in second grcds a si:rHar in:p".ct was 

seen, wliether this impact means that a lower proportion of the 
viev;lr.j second £rade classes vill subsequently need reTuediai 
reading pro^rens than their paired non-viewers is a question 
that is being assessed in a folluw-up scu^, ^ 

Tne non- target second graders seem to have benefited in sortie 
;^ror5. ... ;>cf.sed in i;;£ Electric Batten-, thoug.i the effects were 
e-sncrallv not significant. That is, if a second-grade child is in 
the top half of his grade in tenr.s of national reading norms, few 
.spac.'il benefits roe:n to accrue fron watching The Electric CoTrpanv 
in cl --. Tb.ic i?^y be bocauj;e the content level of the show — 
ihc sKilis bein^ taught ~ are ones that are already possessed or 
o:.. . .1 ."ilL l.-j Ic;.. .cd i:: the olui^r. roon un,!er rcj;u]ar reading 
instruction, or because the measures used in this evaluation did 
not tap art'jK c!iat \-/cre benefitting non-iarget second graders. 
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Significant results were obtained for target components in 
third and fourth grade In several goal areas- The blending area 
measured already seemed mastered even by target third and fourth 
graders; sore impact in the chunking area can be seen 
(specifically, consonant digraphs and larger spelling patterns)- 
The final "e" in scanning was positively affected; and punctuation 
(fourth grade) in the reading for meaning area also was 
positively affected. These benefits were coupled with slight 
but per\''asive benefits that accrued over other goals to yield 
significant results for the grau^ total. Whether this will 
provide "a remedial effect" is an open quest .on at this point. 
Since no negative side-effects were noted, it would seem reason- 
able to look further at third and fourth grade classes to discover 
the long term effects but, to our knowledge, this is not being done. 

Kon- target third and fourth ^;raders seeded to benefit about 
as TT.uch fron^ the shov? as their target coi:-terparts . However, there 

Httl(> ccnslf^tency bet\-7Gf!n sites except in the scanning area 
(final e and couble cousonancs) . Again, a siL^,ht bur. pervasive 
effect rccr^"'<i --^-'cr over many r>ubt^:n?^- to provide significant 
rc'jullr> on I'r.i^ cot-.l tcc;t score. 

As weJ.l as the results fro^i. the si.iils and knowledge sections: 
o£ Hit; Liccirl.: 2.:lt.ery, data ^^cie colIc.iL.,:: on the chiUW.-n's 
attitudes to scnool cnu to readiiir;. Trie .c:.ull:s did not indicate 
any sysLcr.a.ic effectt,. Similarly, tea-he-:^' attitudes to and 

be affected. 
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Teachers who were in the in--school viewing experiment and who 
did use the show in their class roon work generally favored the show 
though some teachers would have preferred not to use it or to use 
it less than once a day* 

Perhaps in keeping with the eclectic approach to reading 
instruction used by Tr.o r.lectrlc Company , teachers were lOt 
apparently influenced by the show to teach reading differently 
fron the niethods the> usually used. Most teachers, it was 
noted, already uoed an eclectic approach to teaching reading. 

Teachers reconnized thnt the show had different uses for 
children froni differing ^-^des • Thus, teachers in third and 
fourth grade thought the show useful for reviewing letter sounds 
and word attack skills whereas teachers in first grade saw the 
show as being u^;eful for teaching skills to the children* 

An investigation was carried out to determine whether The 
Elc ct?-l c Co r.*^r'-r/ was displacing or adding to the time norraally 
spent on reading instruction. Great varxability among classes 
in time spent on reading, as reported by teachers, was noted, 
Ho^ jver, as is to be expected, less time was spent In the higher 
grades and no systeniatic differences were noted betiizeen 
experii:.entai and control classes at pretest, Soine experimental 
cln£-!ii'.s did add to the ar:ount of tir.e ^pent on reading by having 
*nie Klectric Co -^pany displace time from subject areas other than 
reading. However, the results of a comparison of the first grade 
viewing classes in Fresno and Youngs town that did add to the time 
spent on rcadir.^, and those tnat did not add time showed that 
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additional time did not seem to be in itself an important factor 
in the gairji made by the vi-wing classes. 

Parents, too, were used as sources of information for the 
evaluation. In the in-school viewing experiments, parents reported 
no differences in the reading habits of their children out of school. 
The sho..' had no apparent side-effects on parents generally, except 
that parents of viewing first graders seemed to think their 
children were doing better in reading than did parents of control 
first s'^^'^'--^' 

Within the in-school viewing sample were large numbers of 
Spanish-background children (in Fresno) and black children (in 
Youngs town). In both sit^'-s there were also large numbers of white, 
English-speaking children. Analyses were conducted to see if the 
data from these three groups of children looked at separately 
paralled the results of th sample as a whole — that is did 
Spanish-background children (or black, or white) who viewed in 
Pd.ool gnin Croni the show as compared with their non-viewing 
counterparts? The results indicated that the benefit did indeed 
occur acroijfl ail throe population groups. 

Similarly boys who viewed were compared with non-viev.'ing 
boyr, nnd girls with non-vie'.'ing girls. (Each class in the study 
had a boy cotrr-onent and a girl component and it was the class 
that constituted the ..vel at which this analysis ~ and the 
preceeding ethnic-language analyses ~ wes carried out.) Boy5 
tended to have lower scores in reading at pretest. It was found 
that both boys and girls seemed to benefit in all four grades but 
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the size of the effects was greater for girlt in first and fourth 
grades and for boys in second and third grades. 

Another question that was explored was whether black and 
white or color television reception had a differential effect on 
the learning of the viewers. In Youngs town in each grade the two 
kinds of receivers were randomly placed among the viewing classes. 
The results, seemed to. indicate that the color television sets did 
not mediate greater learning among the viewers. Classes viewing 
on black and white sets slightly outgained those viewing on color 
sets in first, second, and fourth grades. No data were analyzed 
to see if the emotional -affective domain was influenced by the 
kind of tele\'lsion reception. 

As well as these analyses of class data in the in-school view- 
ing experiments, some probing analyses v;ere conducted on the effect 
of viewing using children and not classes as the units of analyses. 
Viewing and non- viewing children in each site in each grade were 
classified into ten equal groups (deciles) by level of reading 
achicverent as measured by pretest Metropolitan scores. Results 
for all four grades reinforced previous analyses (summarized above) . 
In 75 of the SO decile groups (ten deciles, four grades, two sites) 
viewers gained more than non-vie^^^ers on the Electric Battery. Tlic 
major sy.;tcinario oxc^^ption was in the lowest decile in all grades. 
Here the prot'.^st scoi^:; were at or below chance level and effects 
of viewing were not apparent. 

Gains on the Metropolitan were also used as a dependent variable 
for decile nnalyses in first and second grades. It was found that. 
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for both grades In both sites, the effects of viewing the show did 
include improvement in Metropolitan scores in some decile groups* 
A final probing analysis involved the intercorrolation of a 
ntmsber of teacher and class variables with post test total score 
(partialing. out pretest score). In order to see if these 
variables had moderating effects on viewing, the intercorrelations 
were calculated separately Tor viewing and non-viewing classes and 
the results compared. No systematic, significant results were 
found. 

The At-HjrAe Vicr.ring I!:-n:erlr.ents 

The data from the eight experiments (first through fourth 
grades separately In each of the V.^o sites — Richmond and 
Washington) were analyzed by comparing the experimental 
(encouraged to vierw at hon:e) classes and their control (not- 
encouraged) classes . 

Evidence on the amount of home viewing was collected from 
parent questionnaires and from viewing records filled in by the 
childrc^n* Data from these measures indicated that children in 
the encouraged clcisses did not view The Elec tric Company 
to a substantially greater diigree than the children in the con- 
trol classes, llius, it ;vrs not surprising to find that there 
were no signi fj^c^nt result.^ in any grade in any site when the 
adjusted gains of the expori mental classes were compared with 
those of the control classes, lliis was also the case when target 
and non-tarK<^t components of the classes were subjected to 
separate analyses. ' 
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In an attempt to extricate whether viewing at home had- an' 
effect on reading scores, analyses of covariance were' also con- 
ducted at the individual child level. Amount of viewing (five 
levels) and the encouraged or not-encouraged condition were entered 
into the analyses. In general these analyses of the data. provided 
little evidence for a beneficial effect of viewing The Electric 
Company at homey although these analyses were based on viewing 
Hjaasures that apparently contained a substantial amount of error. 

Teachers in these at-home viewing experiments held, in 
general, positive vicfTS of the sha-; and many expressed a wish to 
ur-e the shov; as part of their in-school curriculum. No other 
major side-effects of the at-home viewing experiments were noted* 
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Conclusions 

In order to present systematically the major concliislons to be 

dravn fror. the results, the questions that the study was designed 

to answer will again be posed and conclusions drawn. 

1. What are the effects of viewing The Electric Company in school 
on first to fourth grade classes? What are the effects of view- 
ing in school on second grade children who score in the lower 
half of their grade on normed reading achievement tests? What 
are the effects of vie^-ing in school on third and fourth grade 
children who score in the bottom quartlle on normed reading 
achievement tests? 

The experinents conducted to assess the effects of in-school 
vicving incicated that significant positive effects occurred in 
all four grades. The size of the effect appeared to be greatest 

r 

in first and second grades and the effect was generalized across 
goal areas* Third and fourth graders had smaller absolute gains 
from the show. This was due primarily to the fact that at pre- 
test these children already knew much of the curriculum measured 
by the tests. Since they gained significantly from, the show (in 
comparison with their non-vie^^^ing counterparts) it would seem 
that they benefited from the relatively small part of the tested 
curriculimi that was appropriate to their level of achievement in 
reading. 

Target second graders (children scoring in th3 lower half of 
their grade on nonned reading tests) benefited from the show in 
most goal areas. Target third and fourth graders (lowest quarter 
of their respective grades on norrjied receding tests) seemed to 
benefit from the show in relatively few goal areas, although 
target third and fourth graders on the average were performing 
well, at pretest. 
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It Is Inevitable that the question will be raised as to 
whether these statistically significant results, replicated in 
two sites and four grades, are educationally important* As in 
the case of any educational program, this judgment about 
importance ought to be made by those who are responsible for 
the decisions based on that judgnant. The question of whether 
the facnsfit^l" lar-^e cr.ou[;h in ar.y grade to suggest that classes 
use the shc'-r will inevitably be influenced by many other factors, 
not least of vhica will be the ready availability of a television 
set ea\d the attitudes oi the teaciiers toward the show. 

It th5 opinion of the evaluators that the show had a bell 
able in'.pact or* the reading achievci:.ent of classes who vieived in 
school and that this in:pact was larger for the earlier grades. 
All classes in the study received regular reading instruction, 
so that readin^ ins truction on The Electric Company was either 
additional instruction or substitute instruction for classroom 
te?,ct';-ng. la/: of t*..G effect d^'d not seer, to be related to 

whether the teacher used the show in addition to the regular 
reading progr;i2n (anotiier 150 minutes per week of reading) or as 
a substitute ior part of the reguiar reading progran. The impact 
of the r>hc.: in all grades n:\:.st be scon in comparison with the 
eifects oi rcaclL;:^ iiutruciion aia:io« And the results indicate 
th-^.t. vlc^;in;i vir'.i II. v tr\:ct,:on j.s .superior to teacher 
instruction alone, 'ihe results also indicate that the show is 
benefiting children at clifforcnt levels of reading achievement 
and that this benefit includes a small but generally pervasive 
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itcproyement in scores on the Metropolitan — a standardized, normed 
reading test* 

What are the effects of viewing The Electric Con^any in school 
on fin^t to fourth grade children from Spanish-background, on 
blade children, and. on white children? What are the effects 
on first to fourth grade boys and girls? 

The effects of viewing The Electric Company in school were 
quite sltnilar for all the subgroups in the evaluation. The show 
seemed to provide greatest benefit to first graders for all sub- 
groups. While the research design does not allow valid comparisons 
to be made among the subgroups (Just viewing versus non-viewing 
within the subgroups), there was no suggestion from the data that 
marked differences existed. 

Are there any differential effects from viewing The Electric 
Conpany in school on color TV sets versus black and white TV 
sets? 

No systematic, significant differences in the effects of 
viewing in black and white or in color were noted. Although the 
comparisons were based on rather small sample sizes in one site 
only, no systematic effect was evident over all grade levels. 
Tnese conclusions are based on scores indicating gains in read- 
ing skills and comprehension. Whether color versus black and 
white sets have differential aesthetic or motivational impacts 
was not the objective of the study and was not investigated. 

\aiat are the effects of viewing Tlie Electr ic Cq;;:T)any at home on 
first to fourth grade classes? Uliat are t:ie effects of viewing 
at home on second grade children who score in the lower half of 
their grade on normed reading achievement tests? What are the 
effects of viewing at home on third and fourth grade children 
who score in the bottom quartile on normed reading achievement 
tests? 
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Does frequency of viewing affect the show's Impact on children 
viewing at home? 

The experimental design to evaluate at-home viewing broke dcm 
in that control children viewed almost as much as experimental, 
encouraged-td-view children. Thus, not surprisingly, analyses In 
which the gains of these two groups were compared failed to find 
systematic, significant differences across the grades and among 
the several target groups* 

Amount of viewing did not seem, to have any systematic, 
significant effect upon scores. Soice consideration must be given 
to the problem of the assessment of amount of viewing in inter- 
preting this result. It is exceedingly difficult (and expensive) 
to obtain an assessraent of this variable that is free of obvious 
potential errors or biases. The study used two different 
Treasures of amount of viewing the shw and found them to be only 
moderately corielated. VJhether a coniposite or each measure 
considered separately were used to assess amount of viewing, no 
clear effect at any grade level could be found. One possible 
conclusion is that amount of vie.^;ing the sho did not seem to 
infJuence at-hor.c \r!c!\-ers* r^cores. An alternative hypothesis 
that the neasiire^j of vlcving were too error prone is also 
possible. While it is true that in previous studies (of 
So:>an:c.^ Street ) siniilar r»;easure3 of amount of viewing did not 
cloud the presence of significant effects, it is possible that 
the effects of Tlie Electri c Cotr.pany are smaller. And if they 
arc smaller they are r.*orc likely to be ::.is;sed when imprecise 
instruments arc involved. 
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It Is also reasonable. to speculate that the show simply did . 
not have r.uch positive direct impact when viewed at home. One 
would presume that without preparation and follow-up activities 
such as teachers usually supply, and with the added distractions 
and the different approach to viewing that the home usually does 
supply, at-home viewing suffers in relation to in-schcol viewing. 
All this, however, is speculative. 

Does The Electric Company affect the attitudes of children toward 
reading or toward school? 

Does Ihe Electric Compan/ affect attitudes of teachers or parents 
tcrrard the cliildren and their reading performance? What are 
the attitudes of teachers toward the show? 

As far as they were assessed. The Electric Company did not 
affect the attitudes of children toward reading or toward school- 
Presumably the impact of the show is relatively slight in 
relation to all the other factors involved in forming and 
changing these attitudes. Similarly the show did not seem to. 
affect the attitudes of teachers toward their students or to- 
ward their students' reading perforrnance. Tliere was evidence 
that the show had some effect on parental attitudes toward their 
children's reading performance. Among parents of those first 
grads children who viewed in school, there was greater confidence 
that their children were achieving r.t or above an average level 
in reading than amor?, parents of the control, non-viewing first 
grade children» 

The great majority of teachers in all four grades involved in 
the study whose classes viewed in school were generally favorable 
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toward the shew. There were exceptions and a few teachers were 
not favorable. Most, however, felt that the sha* was useful 
both in teaching Cor reviewing) r.3ny of the skills of reading 
taught on the show and in holding tt.e attention of the children. 
The teachers in the at-home viewing study seemed to be somewhat 
more favorably disposed to the shw and many expressed a wish to 
use it in their classrooms. 
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Future Research 

F.TS is currently continuing its evaluation of The Electric Company 
to provide information about the long term effects of viewing in 
school and about the quality of the show to prevent reading problems. 
The follow-up study is being conducted only in the two in-school view- 
ing sites, Fresno and Youngs town, since viewing or non-viewing of the 
show can be tightly controlled in these sites. The study is concerned 
with only the first and second grade children from the first year (who 
are no^v- in second and third grades) since they are the groups of most 
concern and they are still within the grade range that the show is aiir.cd 
at. 

To a large extent children from the first year study did not remair 
in intact classes but rather were tnixed up into classes that in this 
year contain some children who viewed and some who did not view. Within 
a school, these ne.v classes were randon-.ly assigned to viewing and non- 
viewing conditions. In this way. effects of viewing the show will be 
ar.sessod for children who viewed for two years and for children who 
viewed for only one of the two years by comparisons with children who. 
did not vie^c at all. ' 



